Wavefront muxing and demuxing for cloud data storage and transport

ABSTRACT

An apparatus includes N audio receivers positioned in a pre-defined geometry with respect to P audio sources to receive P audio signals from the P audio sources; N data sets coupled to the N audio receivers to sample the received P audio signals into N data streams; a plurality of storage devices coupled to the N data sets to store the N data streams; and a post processor coupled to the plurality of storage devices to generate output signals corresponding to reconstituted P audio signals using a wavefront demultiplexing transformation, wherein N and P are positive integers and N≥P. The post processor has inputs receiving data retrieved from the plurality of storage devices and outputs providing the output signals.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.13/953,715, filed on Jul. 29, 2013, entitled “Wavefront Muxing andDemuxing for Cloud Data Storage and Transport”, which claims priority toprovisional application No. 61/677,013, filed on Jul. 30, 2012,provisional application No. 61/679,781, filed on Aug. 6, 2012, andprovisional application No. 61/815,752, filed on Apr. 25, 2013, all ofwhich are incorporated herein by reference in their entireties.

BACKGROUND OF THE DISCLOSURE Field of the Disclosure

The disclosure relates to methods and architectures of distributed datastorage and data streaming using Wavefront multiplexing (WF muxing). Itis focused on data redundancy, storage reliability, and survivability.The WF muxing techniques will use less memory space to achieve betterredundancy, reliability, and survivability as compared to conventionaltechniques of (1) segmenting, or striping, a stream of data into Msubstreams, (2) creating additional N redundancy among the M substreamsvia parity or equivalent techniques, and (3) encrypting all M+N sets ofsubstreams before storing them in M+N separated data storage space. Inaddition, these techniques enable the capabilities of monitoring dataintegrity of stored data sets without scrutinizing the stored data setsthemselves. The same techniques can be extended to data streaming viacloud.

Brief Description of the Related Art

The existing RAID (redundant array of independent disks) techniques havebeen used extensively for data storage technologies that combinemultiple disk drive components into a logical unit. Data is distributedacross the drives in one of several ways called “RAID levels”, dependingon what level of redundancy and performance (via parallel communication)is required. RAID is an example of storage virtualization and was firstdefined in 1987 by David Patterson, Garth A. Gibson, and Randy Katz atthe University of California, Berkeley. Marketers representing industryRAID manufacturers later attempted to reinvent the term to describe aredundant array of independent disks as a means of dissociating alow-cost expectation from RAID technology. The techniques used toprovide redundancy in a RAID array are through the use of mirroring orparity.

Mirroring is one of the two data redundancy techniques used in RAID (theother being parity). In a redundant array system using mirroring, alldata in the system is written simultaneously to two hard disks insteadof one; thus the “mirror” concept. The principle behind mirroring isthat this 100% data redundancy provides full protection against thefailure of either of the disks containing the duplicated data. Mirroringsetups always require an even number of drives for obvious reasons. Thechief advantage of mirroring is that it provides not only completeredundancy of data, but also reasonably fast recovery from a diskfailure. Since all the data is on the second drive, it is ready to beused if the first one fails. The chief disadvantage of mirroring isexpense: that data duplication means half the space in the redundantarray is “wasted”, so a user must buy twice the capacity that the userwants to end up with in the array. Performance is also not as good assome other techniques.

Duplexing is an extension of mirroring that is based on the sameprinciple as that technique. Like in mirroring, all data is duplicatedonto two distinct physical hard drives. Duplexing processing goes onestep beyond mirroring processing, however, in that a duplexingprocessing also duplicates the hardware that controls the two harddrives (or sets of hard drives). So, if mirroring on two hard disks isimplemented, the two hard disks would both be connected to a single hostadapter or controller. If a “duplexing” processing is implemented, oneof the drives would be connected to one adapter and the other to asecond adapter.

The main performance-limiting issues with disk storage relate to theslow mechanical components that are used for positioning andtransferring data. Since a RAID array has many drives in it, anopportunity presents itself to improve performance by using the hardwarein all these drives in parallel. For example, if a large file is to beread, instead of via a single hard disk, it is much faster to have itchopped up into pieces, some of the pieces stored on each of the drivesin an array, and then all the disks are used to read back the file whenneeded. This technique is called striping, after the pattern that mightbe visible if you could see these “chopped up pieces” on the variousdrives with a different color used for each file. It is similar inconcept to the memory performance-enhancing technique calledinterleaving. Striping can be done at the byte level, or in blocks.Byte-level striping means that the file is broken into “byte-sizedpieces”. The first byte of the file is sent to the first drive, then thesecond to the second drive, and so on. Sometimes byte-level striping isdone as a sector of 512 bytes. Block-level striping means that each fileis split into blocks of a certain size and those are distributed to thevarious drives. The size of the blocks used is also called the stripesize (or block size, or several other names), and can be selected from avariety of choices when the array is set up.

Mirroring is a data redundancy technique used by some RAID levels, inparticular RAID level 1, to provide data protection on a RAID array.While mirroring has some advantages and is well-suited for certain RAIDimplementations, it also has some limitations. It has a high overheadcost, because fully 50% of the drives in the array are reserved forduplicate data; and it doesn't improve performance as much as datastriping does for many applications. For this reason, a different way ofprotecting data is provided as an alternate to mirroring. It involvesthe use of parity information which is redundancy information calculatedfrom the actual data values. The term “parity” has been used in thecontext of system memory error detection; in fact, the parity used inRAID is very similar. The principle behind parity is simple: take “N”pieces of data, and from them, compute an extra piece of data. Take the“N+1” pieces of data and store them on “N+1” drives. If any one of the“N+1” pieces of data is lost, all pieces of data can be recovered fromthe “N” remaining drives, regardless of which piece is lost.

Parity protection is used with striping, and the “N” pieces of data aretypically the blocks or bytes distributed across the drives in thearray. The parity information can either be stored on a separate,dedicated drive, or be mixed with the data across all the drives in thearray.

Compared to mirroring, parity (used with striping) has some advantagesand disadvantages. The most obvious advantage is that parity protectsdata against any single drive in the array failing without requiring the50% “waste” of mirroring; only one of the “N+1” drives containsredundancy information. (The overhead of parity is equal to (100/N)%where N is the total number of drives in the array.) Striping withparity enables advantage of the performance advantages of striping. Thechief disadvantages of striping with parity relate to complexity: allthose parity bytes have to be computed—millions of them per second!—andthat takes computing power.

Norman Ken Ouchi at IBM was awarded a 1978 U.S. Pat. No. 4,092,732titled “System for recovering data stored in failed memory unit”. Theclaims of this patent describe what would later be termed RAID 5 withfull stripe writes. This 1978 patent also mentions that drive mirroringor duplexing (what would later be termed RAID 1) and protection withdedicated parity that would later be termed RAID 4 were prior art atthat time.

Cloud storage refers to saving data to a storage system maintained by athird party. Instead of storing information to a user computer's harddrive or other local storage device, the user saves it to a remotedatabase. The Internet provides the connection between the user'scomputer and the database. In general, cloud storage is convenient andoffers more flexibility. However, the two biggest concerns about cloudstorage are reliability and security [1, 2, 3, 4]. Clients aren't likelyto entrust their data to another company without a guarantee thatthey'll be able to access their information whenever they want and noone else will be able to get at it. To secure data, most systems use acombination of techniques, including (1) encryption, using a complexalgorithm to encrypt information without additional memory size, (2)authentication, creating a user name and password, and (3)authorization; listing the people who are authorized to accessinformation stored on the cloud system. As to reliability, it isgenerally true that cloud storage system reliability is significantlyenhanced with a redundant storage site. Redundancy is to ensure clientsthat they could access their information at any given time, even if oneof many data sites fails.

There are two more concerns. Many operators offer secured and encryptedstorage services. However, secured files are only encrypted on theserver side and therefore a client has to rely on honesty of the serveroperator. The second is concerns about the right of stored data; whichare under debate.

SUMMARY OF THE DISCLOSURE

This invention application addresses enhanced privacy, reliability andsurvivability of stored (image) data, and (image) data transports oncloud via wavefront multiplexing (WF muxing)/demultiplexing (demuxing)methods and techniques. Since stored on multiple image data will bepreprocessed on client sides, each of the stored data on cloud is amultiplexed (muxed) data set individually which is unintelligible byitself. Therefore, the proposed approaches shall remove the concerns onintegrity confidence of operators, and those on the right of storeddata. Camouflaged (image) cloud data storage and transport is onehighlight of this application. Embodiments of “writing” and “reading”processes will be presented. “Writing” features a process on multipleoriginal images concurrently via WF muxing transformations, generatingWF muxed (image) data to be stored on cloud. A “reading” processcorresponds to a WF demuxing transformation on WF muxed (image) datastored on cloud, reconstituting original (image) data sets.

Wavefront multiplexing/demultiplexing (WF muxing/demuxing) processfeatures an algorithm invented by Spatial Digital Systems, Inc. (SDS)for satellite communications where transmissions demand a high degree ofpower combining, security, reliability, and optimization [1,2]. WFmuxing/demuxing, embodying an architecture that utilizesmulti-dimensional transmissions, has found applications in fields beyondthe satellite communication domain. One such application is data storageon cloud where privacy, data integrity, and redundancy are important forboth data transports and data storage.

A method for storing data in IP cloud comprises: transforming multiplefirst data sets into multiple second data sets at a transmitting site,wherein one of said second data sets comprises a weighted sum of saidfirst data sets; storing said second data sets in an IP cloud via anInternet; and storing multiple links linking to said second data sets atsaid transmitting site.

In accordance with an embodiment, the method may comprise storing saidsecond data sets at a receiving site via Internet in accordance withsaid links.

In accordance with an embodiment, the method may comprise transformingsaid second data sets into multiple third data sets at a receiving site,wherein one of said third data sets comprises a weighted sum of saidsecond data sets.

In accordance with an embodiment, one of said second data sets carriesan image with intensities mainly controlled by one of said first datasets.

A data processing method comprises: transforming multiple first datasets and a known data set into multiple second data sets at atransmitting site, wherein one of said second data sets comprises aweighted sum of said first data sets; and recovering a third data setsfrom some of said second data sets and said known data set at areceiving site, wherein one of said third data sets comprises a weightedsum of said some of said second data sets.

A method for storing data in IP cloud, comprises: transforming multiplefirst data sets into multiple second data sets at a transmitting site,wherein one of said second data sets comprises a weighted sum of saidfirst data sets and carries an image with intensities mainly controlledby one of said first data sets.

BRIEF DESCRIPTION OF THE DRAWINGS

The drawings disclose illustrative embodiments of the presentdisclosure. They do not set forth all embodiments. Other embodiments maybe used in addition or instead. Details that may be apparent orunnecessary may be omitted to save space or for more effectiveillustration. Conversely, some embodiments may be practiced without allof the details that are disclosed. When the same reference number orreference indicator appears in different drawings, it may refer to thesame or like components or steps.

Aspects of the disclosure may be more fully understood from thefollowing description when read together with the accompanying drawings,which are to be regarded as illustrative in nature, and not as limiting.The drawings are not necessarily to scale, emphasis instead being placedon the principles of the disclosure. In the drawings:

FIG. 1 depicts a block diagram on distributed data storage for 5independent data sets with nearly identical data size via Wavefrontmuxing techniques and associated retrieval processing from multiplestored data sets.

FIG. 1A depicts a block diagram on distributed data storage for 5independent data sets with nearly identical data size via Wavefrontmuxing techniques, associated retrieval processing when some of thestored data sets are not available.

FIG. 2A depicts a block diagram on distributed data storage for 3independent users U1, U2, and U3 with non-identical data sizes stored inup to 8 storage sites on cloud via Wavefront muxing techniques andassociated retrieval processing from multiple stored data sets.

FIG. 2B depicts a block diagram on retrieval processing from distributeddata storage on cloud for 3 independent users U1, U2, and U3 withnon-identical data sizes stored in multiple stored data sets viaWavefront de-muxing techniques, when some of the stored data sets arenot available.

FIG. 2C depicts a small leading portion of one of 8 stored WF muxed datasets D1-D8 on cloud of a “wild life” video clip opened by Notepad.

FIG. 3 depicts a block diagram on distributed data storage for 5independent data sets with nearly identical data size via Wavefrontmuxing techniques with authentication, associated retrieval processingwhen some of the stored data sets are not available. It may be used forData integrity monitoring.

FIG. 3A depicts how to retrieve the stored data in a scenario that only5 of the 8 stored data sets D′1-D′8 are available from the storage sites131-1 through 131-8.

FIG. 4A illustrates data storage via an analog of acoustic signalprocessing; a conventional technique of storing 3 independent voicestreams via 3 independent microphones and three digitized data sets;

FIG. 4B illustrates data storage via an analog of acoustic signalprocessing; a WF muxed techniques of storing 3 independent voice streamsvia 5 independent microphones and three digitized data sets;

FIG. 4C illustrates data outputs via an analog of acoustic signalprocessing; a WF demuxed processing shall function as 3 acousticorthogonal-beam (OB) beam-forming-network (BFN) for the acoustic arraywith 5 microphones. Each OB beam output is an output of reception patentwith a directional gain peak of the 5-element array steered to one ofthe vocalists, and concurrently 2 independent nulls formed in thedirections of the other vocalists.

FIG. 4D illustrates data retrieval via an analog of acoustic signalprocessing; three streams of acoustic signals are WF muxed into 5 linearcombinations of the three acoustic signals. These muxed signals are thenstored individually on cloud. Only 3 of the 5 stored data are needed torecover any one or all three of the original acoustic signal streams.

FIGS. 4E-4G show orthogonal beams in accordance with the presentinvention.

FIG. 5A illustrates image data storage and transport via wavefrontmuxing by an orthogonal matrix without redundancy, retrieval via acorresponding wavefront demuxing matrix. The muxing/demuxingtransformations are performed pixel-by-pixel.

FIG. 5B illustrates image data storage and transport via wavefrontmuxing by orthogonal matrix with redundancy, retrieval via acorresponding wavefront demuxing matrix. The muxing/demuxingtransformations are performed pixel-by-pixel.

FIG. 5C illustrates image data storage and transport via wavefrontmuxing by a non-orthogonal matrix without redundancy, retrieval via acorresponding wavefront demuxing matrix. The muxing/demuxingtransformations are performed pixel-by-pixel.

FIG. 5D illustrates image data storage and transport via wavefrontmuxing by a non-orthogonal matrix with redundancy, retrieval via acorresponding wavefront demuxing matrix. The muxing/demuxingtransformations are performed pixel-by-pixel.

FIG. 5E illustrates image data storage and transport via wavefrontmuxing by a non-orthogonal matrix without redundancy, retrieval via acorresponding wavefront demuxing matrix. The muxing/demuxingtransformations are performed pixel-by-pixel.

FIG. 6A depicts an example of image storage and transport on clouds withorthogonal WF muxing/demuxing transformations. Camouflaging is one ofthe advantages.

FIG. 6B depicts an example of image storage and transport on cloud withbuilding redundancy via an orthogonal WF muxing transformation.Camouflaging is one of the advantages.

FIG. 6C shows the retrieval processing of the 5 sets of video substreamsfrom user terminals.

FIG. 6D is a top-level functional diagram for retrieving multiple WFmuxed video substreams and converting them into the desired videostream.

FIG. 7A depicts an example of image storage and transport on clouds withnon-orthogonal WF muxing/demuxing transformations. Camouflaging is oneof the advantages.

FIG. 7B depicts an example of image storage and transport on cloud withbuilding redundancy via non-orthogonal WF muxing/demuxingtransformations. Camouflaging is one of the advantages.

FIG. 8A depicts a function diagram of a preprocessing for distributeddata storage on cloud for 1 user data set. These pre-processingfunctions include (1) segmentation, (2) encryptions, (3) redundancy forstored data, and (4) integrity monitoring on stored data.

FIG. 8B depicts a function diagram of a post-processor on distributeddata storage for 1 user data set. These post-processing functionsinclude (1) data integrity verification, (2) removing redundancy, (3)decryptions, and (4) de-segmentation.

FIG. 9A depicts an example of a numerical operation on a set of datawith three different methods for cloud storages.

FIG. 9B compares the required storage sizes on cloud for the threestorage methods for a video clip.

FIG. 9C summarizes the required storage size on cloud for storing and/ortransporting three independent files cloud with building redundancy viaorthogonal WF muxing/demuxing transformations.

DETAILED DESCRIPTION OF THE INVENTION

The present invention relates to distributed data storages with built-inredundancy for a single stream data subdivided into M multiple datasubstreams or M independent data streams, converted into WF muxed domainwith M+N output wavefront components (wfcs), and stored these M+N wfcoutput data into N+M separated data storage sets, where N and M areintegers and N>0. As a result, the stored data sets are wavefrontcomponents in forms of linear combinations of the data sets, instead ofthe data sets themselves.

Let us use an example to illustrate the proposed procedures. A data setS with 6 numerical data points S=[1, 2, 3, 4, 5, 6] will be stored in 4memory sets through the following procedures;

Segmenting S, or striping S, into 3 segments a, b, and c, each of whichconsists of 2 data points:

a=[a1,a2]=[1,2];

b=[b1,b2]=[3,4]; and

c=[c1,c2]=[5,6]

generating a null segment n, where n=[n1, n2]=[0, 0]

putting a, b, c, and n through a Wavefront multiplexing process (a4-to-4 Hadamard matrix), and generating 4 sets of wavefront components(wfcs):

wfc_a=[8,12];

wfc_b=[3,4];

wfc_c=[−1,0], and

wfc_d=[−7,−8]

where the 4-to-4

${{Hadamard}\mspace{14mu} {Matrix}} = \begin{bmatrix}1 & 1 & 1 & 1 \\1 & {- 1} & 1 & {- 1} \\1 & 1 & {- 1} & {- 1} \\1 & {- 1} & {- 1} & 1\end{bmatrix}$

The 4 sets of wfcs, i.e. wfc_a, wfc_b, wfc_c and wfc_d, may be stored in4 separated memory sets, such as 4 individual optical disks or 4individual hard disks for cloud storage, via Internet transmission; thememory sets may be placed in different locations.

When retrieving, the data set S with 6 data points can be restored if 3of the four stored data sets are available.

Alternatively, without losing generality, let us assume M=6 and N=2 forthe following example. As a result of a (N+M)-to-(N+M) WF muxing, eachmemory set stores an individual sum of weighted M (M=6) data substreams,or equivalently a linear combination of all M (M=6) data substreams.Each substream features a unique weighting distribution in the N+M(N+M=8) memory sets. There are M (M=6) weighting components among the M(M=6) data substreams in a memory set, and these M (M=6) weightingcomponents are different from one memory set to another. There are Mweighting distributions in a M+N dimension, which are mutuallyorthogonal to one another in the N+M dimensional space.

Accordingly, for performing the above WF muxing, a wavefront multiplexer(WF muxer) may be provided with (N+M) inputs, e.g. eight inputs in thisexample from eight input data sets respectively, and (N+M) outputs, e.g.eight outputs, i.e. output data sets, in this example, each of which istransmitted via Internet to and stored in one of eight separated memorysets, such as eight individual optical disks or eight individual harddisks in the cloud for cloud storage. Each of the outputs may be alinear combination of the inputs each weighted by a correspondingweighting parameter. Each of the outputs contains information associatedwith all of the inputs.

The present invention also relates to distributed data storages withbuilt-in redundancy for multiple (M) independent data streamsconcurrently converted into WF muxed domain with M+N output wavefrontcomponents (wfcs), and stored these M+N wfc output data into N+Mseparated data storage sets, where N and M are integers and N>0. As aresult, (1) each memory set stores a weighted sum of the M independentdata streams, i.e. a linear combination of all the M independent datastreams, and (2) each data stream features a unique weightingdistribution in the N+M memory sets. There are M weightingdistributions, which are mutually orthogonal to one another in the N+Mdimensional space. Each dimension is associated to an output of the WFmuxer.

When each of the input data sets of a WF muxer feature, a size of 100MB, and each of the output data sets of the WF muxer will then featureabout (1+a)*100 MB. The overhead constant, i.e. a, can be designed to beabout 15% or less. For example, if a 8-to-8 WF muxer has eight inputs inparallel, seven of which comes from input data sets and one of whichcomes from a redundant data set for redundancy, and eight outputs inparallel, each of which is a linear combination of the eight inputsweighted by weighting parameters respectively, the overhead constant,i.e. a, can be about 14.3%. The total input data sets with a size of 700MB will be stored in 8 physical separated memory sites or local folders,i.e. memory sets at a transmitting site, synchronized automatically inseries with 8 respective data storage sites in IP cloud, which may beprovided by different cloud storage providers respectively, viaInternet. Each memory site features a storage of the size of (1+a)*100MB for each of the output data sets. This storage architecture via WFmuxing will have the following feature:

Distributed and securely stored data is processed via “summing andweighting” independent data, not encrypted nor encoded;

Each input data set is stored eight times in 8 different locations witha unique weighting distribution;

Different input data sets are stored in the same memory locations viavarious weighting distributions which are mutually orthogonal to oneanother.

As a result, the stored data, i.e. output data sets, in each storagesite, i.e. memory sets, is a linear combination of all 7 original inputdata sets. With the seven input data sets featuring a total size of 700MB, the eight output data sets only featuring a total size of about 800MB may be used to recover and securely backup the seven input data setsvia only about 14.3%, i.e. overhead constant, of redundant memory size.In another case, the redundant memory size may be less than 50%, or evenless than 20%.

With built-in redundancy for survivability, only 7 of the 8 stored datasets, i.e. output data sets, is required to reconstruct 7 data setssubstantially equivalent the 7 original data sets, i.e. input data sets,if the 7 stored data sets are not contaminated.

The distributed data sets, i.e. output data sets, may be monitored fordata integrity via recovered diagnostic signals, i.e. redundant datasets recovered at a port of a WF demuxing processor, without examiningthe data sets themselves, substantially equivalent to the input datasets, recovered at the other ports of the WF demuxing processor.

The present invention discloses operation concepts, methods andimplementations of distributed data storages via wavefront multiplexingin Cloud storage as depicted in FIG. 1. Similar techniques can beapplied to video streaming, secured mail services, secured filetransfers, and other applications via Internet Clouds. The embodimentsof present inventions comprise three important segments including thepre-storage processing, i.e. the above WF muxing, at a user end,multiple physical data storages, i.e. the above memory sets, in cloud,and a post-retrieval processing, i.e. the above WF demuxing, at the userend. We will use a single user for both pre-storage processing and apost-retrieval processing as an example for illustrating the operationconcepts. In principle, the pre-storage processing and thepost-retrieval processing may be performed in user segments andperformed in equipment at the user end or in storage facilities of anoperator. The operator will aggregate the data storage sets in clouddistributed over remote networks.

Embodiment 1

FIG. 1 depicts an operation concept of using WF multiplexing techniquesfor storing 5 sets of input data 104, S1, S2, S3, S4, and S5 in 8physically separated data storage sites, i.e. memory sets, 131-1 to131-8 connected through IP Cloud or Internet. It also shows a retrievalprocess for the 5 sets of input data. There are three segments including(1) a pre-storage processing 110, (2) cloud storage 130 includingmultiple of the memory sets at downstream of the pre-storage processing110, and (3) post retrieval processing 120 at downstream of the cloudstorage 130. The storage sites, i.e. memory sets, 131-1 to 131-8 mayfeature nearly equal data storage space.

Pre-Storage Processing 110:

In the pre-storage processing, an 8-to-8 WF muxer 101 is used to convert5 sets of input data 104, i.e. S1, S2, S3, S4 and S5, to 8 sets ofoutput data, i.e. D1,D2, D3, D4, D5, D6, D7 and D8, where:

D1=S1+S2+S3+S4+S5  (1-1)

D2=S1−S2+S3−S4+S5  (1-2)

D3=S1+S2−S3−S4+S5  (1-3)

D4=S1−S2−S3+S4+S5  (1-4)

D5=S1+S2+S3+S4−S5  (1-5)

D6=S1−S2+S3−S4−S5  (1-6)

D7=S1+S2−S3−S4−S5  (1-7)

D8=S1−S2−S3+S4−S5  (1-8)

A 8-to-8 Hadamard matrix HM, in which all elements are “1” or “−1” only,or other Fourier full-rank matrix is chosen for the 8-to-8 WF muxing.Equations (1-1) to (1-8) can be written in a matrix form as

$\begin{matrix}{D = {{HM}*S}} & (2) \\{{{where}\text{:}\mspace{14mu} D} = \left\lbrack {{D\; 1},{D\; 2},{D\; 3},{D\; 4},{D\; 5},{D\; 6},{D\; 7},{D\; 8}} \right\rbrack^{T}} & \left( {2\text{-}1} \right) \\{{HM} = \begin{bmatrix}1 & 1 & 1 & 1 & 1 & 1 & 1 & 1 \\1 & {- 1} & 1 & {- 1} & 1 & {- 1} & 1 & {- 1} \\1 & 1 & {- 1} & {- 1} & 1 & 1 & {- 1} & {- 1} \\1 & {- 1} & {- 1} & 1 & 1 & {- 1} & {- 1} & 1 \\1 & 1 & 1 & 1 & {- 1} & {- 1} & {- 1} & {- 1} \\1 & {- 1} & 1 & {- 1} & {- 1} & 1 & {- 1} & 1 \\1 & 1 & {- 1} & {- 1} & {- 1} & {- 1} & 1 & 1 \\1 & {- 1} & {- 1} & 1 & {- 1} & 1 & 1 & {- 1}\end{bmatrix}} & \left( {2\text{-}2} \right) \\{S = \left\lbrack {{S\; 1},{S\; 2},{S\; 3},{S\; 4},{S\; 5},0,0,0} \right\rbrack^{T}} & \left( {2\text{-}3} \right)\end{matrix}$

The input ports of a WF muxer 101 are referred to as slices, and itsoutput ports are wavefront components (wfc's). In this example, the fiveinput data sets 104, i.e. S1, S2, S3, S4 and S5, are connected to theinput ports, i.e. slice 1, slice 2, slice 3, slice 4 and slice 5, of theWF muxer 101 respectively. The 8 output data sets 106, i.e. D1-D8, areconnected to the output ports, i.e. wfc1-wfc8, of the WF muxer 101respectively. When the WF muxer is connected by a unity input data setonly, e.g. S4=[1] through the input port of slice 4, the correspondingoutputs of the WF muxer are written as:

D1=S1+S2+S3+S4+S5=[1]  (3-1)

D2=S1−S2+S3−S4+S5=[−1]  (3-2)

D3=S1+S2−S3−S4+S5=[−1]  (3-3)

D4=S1−S2−S3+S4+S5=[1]  (3-4)

D5=S1+S2+S3+S4−S5=[1]  (3-5)

D6=S1−S2+S3−S4−S5=[−1]  (3-6)

D7=S1+S2−S3−S4−S5=[−1]  (3-7)

D8=S1−S2−S3+S4−S5=[1]  (3-8)

The 8 output data sets are represented as a column vector or an outputcolumn matrix. The elements of the output matrix D, under the condition,become identical to the 8 elements of the 4^(th) column in the HM. Inthis case, the wavefront vector of the output data sets representing thematrix D is referred to as the 4^(th) wavefront vector (WFV), or WFV4.Similarly, the wavefront vector associated with the k^(th) input port,Slice k, is referred to as k^(th) WFV or WFVk. A WF vector specifies thedistribution of a set of input data among the 8-output ports or among 8aggregated output data sets, i.e. D1, D2, D3, D4, D5, D6, D7 and D8.

In general, an 8-to-8 WF muxer, such as the WF muxer 101, features 8orthogonal WFV's. Let us define a coefficient wjk of a WF transformationperformed by the WF muxer 101 to be the coefficient at the j^(th) rowand k^(th) column of the WF muxer 101. A WF vector of the WF muxer 101featuring a distribution among the 8 outputs, i.e. D1-D8 at the 8 WFcomponent ports wfc1-wfc8, is defined as an 8-dimensional vector. Theyare mutually orthogonal.

The first 5 WFVs of the WF muxer 101 are:

WFV1=[w11,w21,w31,w41,w51,w61,w71,w81]^(T)  (4.1)

WFV2=[w12,w22,w32,w42,w52,w62,w72,w82]^(T)  (4.2)

WFV3=[w13,w23,w33,w43,w53,w63,w73,w83]^(T)  (4.3)

WFV4=[w14,w24,w34,w44,w54,w64,w74,w84]^(T)  (4.4)

WFV5=[w15,w25,w35,w45,w55,w65,w75,w85]^(T)  (4.5)

S1, S2, S3, S4, and S5 are “attached” to 5 WF vectors by respectivelyconnected to the first five input ports of the WF muxing device, i.e. WFmuxer, 101. There are 3 remaining WFVs, i.e. WFV6, WFV7 and WFV8, whichare not “utilized” in this illustration. All components of the 8orthogonal WFVs are related to input and output port numbers or(spatial) sequences, but are independent from the input and output datasets.

The arithmetic operations of “linear combinations” may operate on blocksof data after all inputs are aligned as digital streamssample-after-sample for various inputs. A “byte” of data may be“selected” as a sample and a block of X samples, i.e. 7 samples or 7bytes, of a digital data stream will be treated as a numerical numberfor calculations in WF muxing transformations. The 7 samples or bytesmay be the 7 respective inputs of the 8-to-8 WF muxer. A block size ofX+1 samples, i.e. 8 samples or 8 bytes in this case, will be reservedfor the results of arithmetic operations on a number of the digitalstreams to avoid issues of overflows and underflows at the outputs ofthe WF muxing transformations. There shall be 12.5% in data sizeoverhead of the 7 byte arithmetic operations, with respect to theresults in 8 byte forms in the outputs. In different embodiments, we maychoose blocks with a block length of 99 bytes for arithmetic operation,i.e. X=99, reducing the operation overhead to 1%.

There are other choices in selecting data blocks for arithmeticoperations of linear combinations or weighted sums in the WF muxingtransformations. For imaging processing, a pixel by pixel as operationblocks may be more important preserving unique features for someapplications, or a row or a column of pixels as a data block forefficient usage of storage. In this case, each seven pixels, for 7respective inputs of the 8-to-8 WF muxer, may be set as a block.Alternatively, each block may be set with greater than 3 pixels forgreater than 3 inputs of a WF muxer. Alternatively, each block may beset with greater than 100 pixels for greater than 100 inputs of a WFmuxer. In acoustic (music and audio data) processing, sample-by-sampleas operation blocks offer flexibility in data storage and transport oncloud. In this case, each seven samples, for 7 respective inputs of the8-to-8 WF muxer, may be set as a block. Alternatively, each block may beset with greater than 3 samples for greater than 3 inputs of a WF muxer.Alternatively, each block may be set with greater than 100 samples forgreater than 100 inputs of a WF muxer.

The 8 output data sets 106, i.e. D1-D8, at the 8 wfc ports of the WFmuxer 101 feature 8 different linear combinations of the 5 input datasets weighted by 5 respective weighting parameters in one of 8 wavefrontvectors each for a corresponding one of the linear combinations, or 8aggregated data sets each containing one of the 8 linear combinations.Each aggregated data set is a weighted sum of the 5 input data sets,which are completely independent to one another; for example, one of theinput date sets may be a power point presentation, another of the inputdata sets may be a multimedia data file, the third one of the input datasets may be a word document, and so on. As a result, each of the 8aggregated data sets D1-D8 features a result of structured arithmeticoperations (weighting, or multiplying, and summing) on the 5 independentdata sets S1-S5. The 8 aggregated or WF muxed video substreams D1-D8appear as 8 respective data sets with random numbers. The muxingprocessor 103, such as time, frequency or code domain multiplexer, willallow the 8 pre-processed data sets, i.e. the output data sets D1-D8from the WF muxer 101 in parallel, to be muxed based on time, frequencyor code and delivered in series through a single pipe, or communicationoutput port 107 to various data storage sites 131-1 through 131-8 in IPCloud 130 via Internet.

Cloud Storage 130:

As shown in FIG. 1, the five independent data sets 104, i.e. S1, S2, S3,S4 and S5, and three independent data sets 108 are muxed by the WF muxer101 into eight data sets D1-D8 to be stored in 8 local folders, i.e.memory sets at a transmitting site, synchronized automatically in serieswith 8 respective data storage or mirror sites 131-1 through 131-8 in IPcloud 130, which may be provided by different cloud storage providersrespectively, via Internet. Furthermore, multiple links linking to theeight data sets stored in the eight respective data storage or mirrorsites 131-1 through 131-8 may be passed to one or more of the datastorage or mirror sites 131-1 through 131-8 and/or stored in thetransmitting site. Some of the data sets D1-D8 may be stored loccally atthe transmitting site. The output data sets from the WF muxer 101 are informs of streams of numerical numbers as results of 8 different linearcombinations of the same five data sets. Each of the 8-storage sites131-1, 131-2, 131-3, 131-4, 131-5, 131-6, 131-7, and 131-8, i.e. memorysets, only stores an assigned one of the 8 WF muxed data sets 106, i.e.the output data sets. The data storage sites 131-1 through 131-8 maystore the output data sets 106, i.e. D1-D8, respectively. The 8processed data sets, or WF muxed data sets 106, are the output datasets, i.e. D1, D2, D3, D4, D5, D6, D7 and D8. Each of the WF muxed datasets 106 is not comprehensible, and/or may appear with misleadinginformation.

Post retrieval processing 120:

Referring to FIG. 1, the post retrieval processor 120 may include ademuxing processor 113, such as time, frequency or code domaindemultiplexer, that will recover data sets 116, i.e. D′1-D′8, inparallel based on time, frequency or code from the data sets, stored in8 separated local folders, i.e. memory sets in a local memory device ata receiving site, synchronized automatically in series with the 8respective storage or mirror sites 131-1, 131-2, 131-3, 131-4, 131-5,131-6, 131-7 and 131-8 in IP Cloud storage 130 via Internet optionallyin accordance with the links passed from one or more of the storage ormirror sites 131-1 through 131-8 or transmitting site to the receivingsite, so as to enable users to retrieve original input data setsS′1-S′5, substantially equivalent to the input data sets S1-S5respectively, by a WF demuxing transformation 111. The data sets 116,i.e. D′1-D′8, may be substantially equivalent to the data sets 106, i.e.D1-D8, respectively.

Referring to FIG. 1, in the post-retrieving processing, a 8-to-8 WFdemuxer 111 is used to convert 8 sets of stored data sets 116, i.e. D′1,D′2, D′3, D′4, D′S, D′6, D′7 and D′8, substantially equivalent to theoutput data sets, i.e. D1, D2, D3, D4, D5, D6, D7 and D8, respectivelyif not contaminated, into 5 sets of recovered outputs 114, i.e. S′1,S′2, S′3, S′4 and S′S, substantially equivalent to the input data sets,i.e. S1, S2, S3, S4 and S5, respectively, where

S′1=(D′1+D′2+D′3+D′4+D′5+D′6+D′7+D′8)/8  (5-1)

S′2=(D′1−D′2+D′3−D′4+D′5−D′6+D′7−D′8)/8  (5-2)

S′3=(D′1+D′2−D′3−D′4+D′5+D′6−D′7−D′8)/8  (5-3)

S′4=(D′1+D′2+D′3+D′4+D′5+D′6+D′7+D′8)/8  (5-4)

S′5=(D′1+D′2+D′3+D′4−D′5−D′6−D′7−D′8)/8  (5-5)

S′6=(D′1−D′2+D′3−D′4−D′5+D′6−D′7+D′8)/8  (5-6)

S′7=(D′1+D′2−D′3−D′4−D′5−D′6+D′7+D′8)/8  (5-7)

S′8=(D′1+D′2+D′3+D′4+D′5+D′6+D′7+D′8)/8  (5-8)

An 8-to-8 Hadamard matrix or other inverse Fourier full-rank matrix withscaling factor of ⅛ may be chosen as the 8-to-8 WF demuxer. The matrixelements of 8-to-8 Hadamard matrix feature “1” or “−1” only. Equations(5-1) to (5-8) may also be written in a matrix form as

S′=HM*D  (6)

Where: D=[D′1,D′2,D′3,D′4,D′5,D′6,D′7,D′8]^(T)  (6-1)

S′=[S′1,S′2,S′3,S′4,S′5,S′6,S′7,S′8]^(T),  (6-2)

-   -   and the 8-to-8 Hadamard matrix HM is expressed in equation        (2-2).

The input ports of a WF demuxer 111 are referred to as wavefrontcomponents (wfcs), i.e. wfc1′, wfc2′, wfc3′, wfc4′, wfc5′, wfc6′, wfc7′and wfc8′, and its output ports are slices, i.e. slice1′, slice2′,slice3′, slice4′, slice5′, slice6′, slice7′ and slice8′. In thisexample, the 8 input data sets 116, i.e. D′1-D′8, are connected to itsinput ports wfc1′-wfc8′ of the WF demuxer 111, respectively. The fiveretrieved data sets 114, i.e. S′1-S′5, are connected to its outputports, i.e. slice1′ through slice5′, respectively. The three retrieveddata sets 118, i.e. S′6-S′8 are connected to its output ports, i.e.slice6′ through slice8′, respectively. Each of the outputs or retrieveddata sets 114 and 118, i.e. S′1-S′8, may be a linear combination of theinputs 116, i.e. D′1-D′8, each weighted by a corresponding weightingparameter. Each of the outputs or retrieved data sets 114 and 118, i.e.S′1-S′8, contains information associated with all of the inputs 116,i.e. D′1-D′8.

When the retrieved data sets of S′6, S′7, and S′8 118 feature data setswith zeros or negligibly small numbers representing empty data sets, andthey are the indications that the retrieved data sets 114 have not beencontaminated in the storage sites 131 of Cloud storage 130 or duringtransports in the storing and retrieving processes 107 and 117. As aresult, the retrieved data sets of S′1, S′2, S′3, S′4 and S′5 will beidentified with confidence as the retrieved data sets of S1, S2, S3, S4,and S5, respectively. On the other hand, when the retrieved data sets ofS′6, S′7, and S′8 118 feature non-zeros or numbers which arenon-negligibly small, representing data sets which are not empty sets,and implying the retrieved data sets 114, i.e. S′1, S′2, S′3, S′4 andS′5, are contaminated either in storage sites 131-1 through 131-8 in theCloud storage 130 or during transportation for the data sets D1-D8 fromthe WF muxer 101 to the Cloud storage 130 or for the data sets D′1-D′8from the Cloud storage 130 to the WF demuxer 111.

This feature will be used as data integrity monitoring for storages oncloud based on the outputs or retrieved data sets 118 of S′6, S′7 or S′8from the WF demuxer 111. Operators may not have access to the outputs114 or retrieved data sets 118 of, S′3, S′4 and S′5 at all. Theseoperators will be able to monitor the integrity of the 5 retrieved datasets 114 of S′1, S′2, S′3, S′4 and S′5 stored on cloud without accessingthe retrieved data sets 114 of S′1, S′2, S′3, S′4 and S′5 themselves.

Data storage/retrieval processing 100 comprises of both the pre-storageprocessing 110 and post retrieval processing 120.

Further processing may be required to restore the stored data referringto FIG. 1A, which is identical to FIG. 1 except the post retrievalprocessing or the data reading 111 a. FIG. 1A features a new postretrieval processing or the data reading 111 a. With only 5 unknown datasets of D′2, D′3, D′4, D′S and D′8, 8 linear combinations S′1-S′8 can becreated. Each of the linear combinations S′1-S′8 may be combined by the5 unknown data sets D′2, D′3, D′4, D′5 and D′8 weighted by fiveweighting parameters respectively. It is possible to identify 3contaminated ones, D′1, D′6 and D′7, from the 8 stored data sets basedon the 8 different linear combinations. The extra data sets shall beused for better survivability, better reliability, and betterauthentications.

As indicated in this example, the storage sites for D′1, D′6 and D′7 arenot accessed or applied. Only D′2, D′3, D′4, D′S, and D′8 data sets areaccessible and retrievable via retrieval paths, where

D′2=S′1−S′2+S′3−S′4+S′5  (7-1)

D′3=S′1+S′2−S′3−S′4+S′5  (7-2)

D′4=S′1−S′2−S′3+S′4+S′5  (7-3)

D′5=S′1+S′2+S′3+S′4−S′5  (7-4)

D′8=S′1−S′2 31 S′3+S′4−S′5  (7-5)

Therefore, S′1, S′2, S′3, S′4, and S′5 can then be solved by a modifiedwavefront demuxer 111 a as:

S′1=(D′2+D′3+D′5+D′8)/4  (7-6)

S′5=(D′4−D′8)/2  (7-7)

S′3=(D′2+D′5)/2−S′1  (7-8)

S′2=(D′5−D′8)/2−S′3  (7-9)

S′4=(D′3−D′4)/2+S′2  (7-10)

There are many different combinations of taking 5 WF muxed data sets 117from 8 ones stored in the eight data storage sites 131-1 through 131-8.In this case, there are 56 possible combinations of availabilities. Themodified WF muxer 111 a shall be designed to handle all possiblecombinations. The unavailability of the stored data may be caused byphysical site damages, electronic upsets on the data contents, sabotagedby hackers, and/or by other causes.

Similar to FIGS. 1 and 1A, FIG. 2A depicts a writing process; anoperation concept of using WF multiplexing techniques to store 5 sets ofdata 104, i.e. S1, S2, S3, S4 and S5, in 8 physically separated datastorage sites 131 connected through IP Cloud, except the first threedata sets, S1, S2 and S3, are generated by segmenting a large data set105 belonged to a first user, U1, by a segmentation processor 102. Dataset 105 is a short video clip on wild life. Input data sets S4 and S5belong to second and third users, U2 and U3 respectively. Each of theoutputs or data sets 106, i.e. D1-D8, may be a linear combination of theinputs 104 and 108, i.e. including S1-S5, each weighted by acorresponding weighting parameter. Each of the outputs 106, i.e. D1-D8,contains information associated with all of the inputs 104 and 108, i.e.including S1-S5. The data storage sites 131-1 through 131-8 may storethe output data sets 106, i.e. D1-D8, respectively. Elements in FIG. 2Ahaving the same reference number as those in FIGS. 1 and 1A may refer tothose illustrated in FIGS. 1 and 1A.

Similar to FIG. 1A, FIG. 2B depicting a reading process, the WFdemultiplexing techniques may be used to retrieve 5 sets of data 114,i.e. S′1, S′2, S′3, S′4 and S′5, from five data sets of D′2, D′4, D′5,D′7 and D′8 derived from five of the eight physically separated datastorage sites 131-1 through 131-8 connected through IP Cloud. The firstthree data sets, i.e. S′1, S′2, and S′3, are to be de-segmented orcombined into a large data set 115, i.e. U′1, substantially equivalentto the input data set U1 in FIG. 2A, by a de-segmentation processor 112.Referring to FIG. 2B, it shows the retrieval processing of the 5 sets ofdata 114, i.e. S′1-S′5 substantially equivalent to the input data setsS1-S5 respectively in FIG. 2A, when only 5 stored data sets, i.e. D′2,D′4, D′S, D′7 and D′8 substantially equivalent to the data sets D2, D4,D5, D7 and D8 respectively in FIG. 2A, are accessible from five of theeight storage sites 130-1 through 131-8. Each of the outputs orretrieved data sets 114, i.e. S′1-S′S, may be a linear combination ofthe inputs 116, i.e. D′2, D′4, D′S, D′7 and D′8, each weighted by acorresponding weighting parameter. Each of the outputs or retrieved datasets 114, i.e. S′1-S′5, contains information associated with all of theinputs 116, i.e. D′2, D′4, D′S, D′7 and D′8. The retrieval processfurther includes the grouping of the first 3 retrieved data sets, i.e.S′1, S′2, and S′3, into a large data set 115, i.e. U′1, via ade-segmentation processor 112, which is accessible to a user authorizedby another user storing the data set U1 through the segmenting process102 and WF muxing 101. The retrieved data sets, i.e. S′4 and S′S,substantially equivalent to the input data sets S4 and S5 respectivelyin FIG. 2A, are delivered to users U′2 and U′3 authorized by users U2and U3 in FIG. 2A, respectively. Elements in FIG. 2B having the samereference number as those in FIGS. 1 and 1A may refer to thoseillustrated in FIGS. 1 and 1A.

FIG. 2C depicts a small leading portion of one of 8 stored WF muxed datasets D1-D8 on cloud of a “wild life” video clip opened by Notepad.Except a few blocks of the first line, the file is incomprehensible.

Embodiment 2

FIG. 3 depicts an operation concept of using the above WF multiplexingtechniques for storing 5 sets of data 104, i.e. S1, S2, S3, S4 and S5,as well as a diagnostic/authentication data set 105A, i.e. Sx, in the 8data storage sites 131-1 through 131-8 physically separated butconnected through IP Cloud. Referring to FIG. 3, it also shows theretrieval processing of the 5 data sets 114, i.e. S′1, S′2, S′3, S′4 andS′5, and the diagnostic and authentication set S′x 115A from the 8storage site 131-1 through 131-8. It is assumed the 5 data sets 104,i.e. S1, S2, S3, S4 and S5, and the diagnostic/authentication data set105A, i.e. Sx, feature nearly identical data sizes. Each of the outputsor data sets 106, i.e. D1-D8, may be a linear combination of the inputs104 and 108, i.e. including S1-S5 and Sx, each weighted by acorresponding weighting parameter. Each of the outputs 106, i.e. D1-D8,contains information associated with all of the inputs 104 and 108, i.e.including S1-S5 and Sx. The data storage sites 131-1 through 131-8 maystore the output data sets 106, i.e. D1-D8, respectively. Elements inFIG. 3 having the same reference number as those in FIGS. 1 and 1A mayrefer to those illustrated in FIGS. 1 and 1A.

Referring to FIG. 3, there are three segments: (1) a pre-storageprocessing 110, (2) cloud storage 130 and (3) post retrieval processing120. The data storage sites 131-1 through 131-8 in the cloud storage 130feature nearly equal data storage space. The data storage/retrievalprocessing 100 comprises of the pre-storage processing 110 and the postretrieval processing 120.

Referring to FIG. 3, the main difference between the embodiment 2 andthe embodiment 1 is the presences of diagnostic/authentication data set105A, which may be fixed data sets, periodically configurable data sets,or dynamic data sets. In this example, we will use a fixeddiagnostic/authentication data set to illustrate the unique features ofthe architectures and their operations. The diagnostic/authenticationdata set 105A shall be known data sets to users or/and data storageadministrators. The diagnostic/authentication data set 105A may bedigital files of famous paintings, good quality pictures, or multi-mediadata.

Pre-Storage Processing:

Referring to FIG. 3, in the pre-storage processing 110, a 8-to-8 WFmuxer 101 is used to convert 5 sets of data 104, i.e. S1, S2, S3, S4 andS5, and 1 set of diagnostic/authentication data 108, i.e. Sx, into 8sets of outputs 106, i.e. D1, D2, D3, D4, D5, D6, D7 and D8, where

D1=S1+S2+S3+S4+S5+Sx  (8-1)

D2=S1−S2+S3−S4+S5−Sx  (8-2)

D3=S1+S2−S3−S4+S5+Sx  (8-3)

D4=S1−S2−S3+S4+S5−Sx  (8-4)

D5=S1+S2+S3+S4−S5−Sx  (8-5)

D6=S1−S2+S3−S4−S5+Sx  (8-6)

D7=S1+S2−S3−S4−S5−Sx  (8-7)

D8=S1−S2−S3+S4−S5+Sx  (8-8)

A 8-to-8 Hadamard matrix in which all elements are “1” or “−1” only hasbeen chosen as the 8-to-8 WF muxer. Equations (1-1) to (1-8) can bewritten in a matrix form as

D=HM*Sa  (8-9)

Where: D=[D1,D2,D3,D4,D5,D6,D7,D8]^(T)  (8-9a)

Sa=[S1,S2,S3,S4,S5,Sx,0,0]^(T),  (8-9b)

-   -   and the 8-to-8 Hadamard matrix is expressed in equation (2-2).

Referring to FIG. 3, the input ports of a WF muxer 101 are referred toas slices, and its output ports are wavefront components (wfcs). In thisexample, the five input data sets 104, i.e. S1-S5, are connected to theinput ports, i.e. slice1-slice5, of the WF muxer 101 respectively. Theinput port, i.e. slice6, of the WF muxer 101 is assigned to the inputdata set 108, i.e. Sx, and the input ports, i.e. slices7 and slice8, ofthe WF muxer 101 are grounded, i.e. assigned to two respective redundantdata sets. The 8 output data sets 106, i.e. D1-D8, are connected to theoutput ports, i.e. wfc1-wfc8, respectively.

When the WF muxer 101 is only connected by a unity input data set, e.g.S4=[1] through the input port of slice 4, the corresponding outputs ofthe WF muxer are written as

D1=S1+S2+S3+S4+S5+Sx=[1]  (9-1)

D2=S1−S2+S3−S4+S5−Sx=[−1]  (9-2)

D3=S1+S2−S3−S4+S5+Sx=[−1]  (9-3)

D4=S1−S2−S3+S4+S5−Sx=[1]  (9-4)

D5=S1+S2+S3+S4−S5+Sx=[1]  (9-5)

D6=S1−S2+S3−S4−S5−Sx=[−1]  (9-6)

D7=S1+S2−S3−S4−S5−Sx=[−1]  (9-7)

D8=S1−S2−S3+S4−S5+Sx=[1]  (9-8)

Referring to FIG. 3, the 8 output data sets D1-D8 can be represented asan output data matrix, D. The elements of the output matrix D, under thecondition, become identical to the 8 elements of the 4^(th) column inthe HM. The vector representing the matrix is referred to as the 4^(th)wavefront vector (WFV), or WFV4. Similarly, the wavefront vector isassociated with the k^(th) input port, i.e. slice k is referred to ask^(th) WFV or WFVk. A WF vector specifies a unique distribution of a setof input data among the 8-output ports or among 8 aggregated output datasets, i.e. D1, D2, D3, D4, D5, D6, D7 and D8. In general an 8-to-8 WFmuxer, such as the WF muxer 101, features 8 orthogonal WFV's. Let definea coefficient wjk of a WF transformation performed by the WF muxer 101to be the one in the position of j^(th) row and k^(th) column of a WFmuxer. A WF vector of the WF muxer 101 featuring a distribution amongthe 8 outputs, the 8 WF component (wfc) ports, is defined as an8-dimensional vector. They are mutually orthogonal. The first 5 WFVs ofthe WF muxer 101 are:

WFV1=[w11,w21,w31,w41,w51,w61,w71,w81]^(T)  (10.1)

WFV2=[w12,w22,w32,w42,w52,w62,w72,w82]^(T)  (10.2)

WFV3=[w13,w23,w33,w43,w53,w63,w73,w83]^(T)  (10.3)

WFV4=[w14,w24,w34,w44,w54,w64,w74,w84]^(T)  (10.4)

WFV5=[w15,w25,w35,w45,w55,w65,w75,w85]^(T)  (10.5)

The input data sets 104, i.e. S1, S2, S3, S4, and S5, are connected tothe first five input ports, i.e. slice1-slice5, of the WF muxer 101 soas to be “attached” to 5 WF vectors, i.e. WFV1-WFV5. Thediagnostic/authentication data set Sx, is attached to the 6^(th) WFV, orWFV6, where:

WFV6=[w16,w26,w36,w46,w56,w66,w76,w86]^(T)  (10.6)

There are 2 remaining WFVs, i.e. WFV7 and WFV8, which are not“activated” in this case. The associated input ports, i.e. slices 7 and8, are grounded, i.e. assigned to two respective redundant data sets. Bydoing these, on the other hand, it can be viewed that two additionaldata sets, i.e. the last two of the input data set 108, with elements of“zeros” are riding on the two WF vectors. These two “null” data setscomprise empty elements.

All components of the 8 orthogonal WFVs are completely independent ofinput and output data sets, but are related to the sequence of the inputand output ports of the WF muxer 101. The 8 outputs or output data set106, i.e. D1, D2, D3, D4, D5, D6, D7 and D8, at the 8 output ports, i.e.wfc1-wfc8, of the WF muxer 101 feature 8 different linear combinationsof the 5 input data sets 104, i.e. S1-S5, and one diagnostic data setSx, or feature 8 aggregated data sets. Each aggregated data set is aweighted sum of the 5 input data sets 104, i.e. S1-S5, plus onediagnostic data set Sx. These inputs S1-S5 and Sx are completelyindependent; one may be a power point presentation, another may be amultimedia data file, the third may be a word document, and so on. As anexample, the diagnostic data set 109 may be a digital picture file of aChinese painting of “running houses” by a famous artist of Mr. HsuPei-hung. As a result, the 8 aggregated data sets 106, i.e. D1-D8,feature results of structured arithmetic operations (weighting, ormultiplying, and summing) on 5 independent data sets 104, i.e. S1-S5,plus the digital data file, i.e. S6, of a painting with the title of“running horses”. The outputs 106 of the WF muxer 101 shall appear 8separated data sets, i.e. D1-D8, with various random numbers, to bestored on the storage sites 131-1 through 131-8 respectively.

Referring to FIG. 3, the muxing processor 103, such as time, frequencyor code domain multiplexer, will allow the 8 pre-processed data sets106, i.e. the output data sets D1-D8 from the WF muxer 101 in parallel,to be muxed based on time, frequency or code and then delivered to 8respective local folders, at a transmitting site, synchronizedautomatically in series with 8 respective data storage or mirror sites131-1 through 131-8 in IP Cloud storage 130 through a single pipe, orcommunication output port 107 via Internet. Furthermore, multiple linkslinking to the eight data sets stored in the eight respective datastorage or mirror sites 131-1 through 131-8 may be passed to one or moreof the data storage or mirror sites 131-1 through 131-8 and/or stored inthe transmitting site. Some of the data sets D1-D8 may be stored locallyat the transmitting site. One of the operational concepts of thisconfiguration is to reserve a fixed number, i.e. 8, of data storagesites 131 for storing 8 output data sets D1-D8 each containinginformation related to the 5 input data sets 104, i.e. S1-55. Everyindividual storage site 131-1 through 131-8 shall feature a memory sizewith a few percent, e.g. less than 15%, more than any one of the datasets 104, i.e. S1-S5, and more than the diagnostic/authentication dataset Sx. All 8 sets of distributed memories, i.e. storage sites 131-1through 131-8, will be used for storing the eight output data sets D1-D8respectively, independent of whether one set of data (S1 only) or 5 setsof data (S1, S2, S3, S4, S5) are stored across the 8 assigned storagememory sets 131-1 through 131-8 distributed in separated sites.

For example, referring to FIG. 3, when only a first data set, S1, isstored, each of the 8 memory sites 131-1 through 131-8 stores a sum ofthe first data set (S1) weighted by a parameter in the wavefront vectorWFV1 plus the diagnostic/authentication data (Sx) weighted by aparameter in the wavefront vector WFV6. The weightings, i.e. parameters,for the first data set (S1) in the 8 memory sites 131-1 through 131-8are expressed as an 8-dimensional vector or a vector with 8 components.This vector is referred to as the first wavefront vector (1st WF vector)or WFV1. Similarly, the weightings, i.e. parameters, for thediagnostic/authentication data set Sx in the 8 memory sites 131-1through 131-8 are expressed as another 8-dimensional vector or anothervector with 8 components. This vector is referred to as the 6^(th)wavefront vector (6^(th) WF vector) or WFV6.

Furthermore, WFV1 and WFV6 are mutually orthogonal. It is important tomake the following observations: (1) each of the 5 input data sets 104,i.e. S1-55, is muxed by the WF muxer 101 into eight output data setsD1-D8 stored in the eight data memory sets 131-1 through 131-8respectively; and (2) each of the 8 memory sites 131-1 through 131-8stores storage formats of a weighted sum of the input data sets S1-S5.

Cloud Storage 130:

As shown in FIG. 3, the five independent data sets 104, i.e. S1, S2, S3,S4 and S5, and the diagnostic/authentication data set Sx are muxed bythe WF muxer 101 into the output data sets D1-D8 that may be stored inthe 8 storage sites 131-1 through 131-8 respectively in IP Cloud 130 informs of 8 respective linear combinations, each of which is a linearcombination of the same five data sets 104, i.e. S1-55, each multipliedby a weighting parameter in a corresponding one of the WF vectorsWFV1-WFV5, plus the diagnostic/authentication data set Sx multiplied bya weighting parameter in the WF vector WFV6. Each of the storage sites131-1 through 131-8 stores an assigned one of the 8 processed data sets106, i.e. D1, D2, D3, D4, D5, D6, D7 and D8. The storage sites 131-1through 131-8 store the output data sets D1-D8, i.e. the eightrespective linear combinations, respectively.

Post Retrieval Processing 120:

Referring to FIG. 3, the post retrieval processing 120 may include ademuxing processing 113, such as time, frequency or code domaindemultiplexer, that will recover parallel data sets 116, i.e. D′1-D′8,if not contaminated, substantially equivalent to the data sets D1-D8respectively, based on time, frequency or code from the data sets,stored in 8 separated local folders, i.e. memory sets in a local memorydevice at a receiving site, synchronized automatically in series withthe 8 respective storage or mirror sites 131-1 through 131-8 in IP Cloudstorage 130 via Internet optionally in accordance with the links passedfrom one or more of the storage or mirror sites 131-1 through 131-8 ortransmitting site to the receiving site. The 8 stored data sets areallowed to be retrieved through the single pipe, or communication outputport 117 from various data storage sites 131-1 through 131-8 in IP Cloudstorage 130.

In the post-retrieval processing 120, a 8-to-8 WF demuxer 111 is used toconvert 8 sets of stored data 116, i.e. D1, D2, D3, D4, D5, D6, D7 andD8, into 5 sets of outputs 114, i.e. S′1, S′2, S′3, S′4 and S′5, and oneset of diagnostic/authentication data (S′x) 119, where:

S′1=(D1+D2+D3+D4+D5+D6+D7+D8)/8   (11-1)

S′2=(D1−D2+D3−D4+D5−D6+D7−D8)/8  (11-2)

S′3=(D1+D2−D3−D4+D5+D6−D7−D8)/8  (11-3)

S′4=(D1+D2+D3+D4+D5+D6+D7+D8)/8  (11-4)

S′5=(D1+D2+D3+D4−D5−D6−D7−D8)/8  (11-5)

S′x=(D1−D2+D3−D4−D5+D6−D7+D8)/8  (11-6)

S′7=(D1+D2−D3−D4−D5−D6+D7+D8)/8  (11-7)

S′8=(D1+D2+D3+D4+D5+D6+D7+D8)/8  (11-8)

An 8-to-8 Hadamard matrix with scaling factor of ⅛ has been chosen asthe 8-to-8 WF demuxer 111. The matrix elements of the 8-to-8 Hadamardmatrix features “1” or “−1” as depicted in the equation (2-2). Equations(11-1) to (11-8) may also be written in a matrix form as:

S′=HM*D′  (11-9)

where: D=[D′1,D′2,D′3,D′4,D′5,D′6,D′7,D′8]^(T)  (11-10)

S′=[S′1,S′2,S′3,S′4,S′5,S′x, 0,0]^(T),   (11-11)

-   -   and the 8-to-8 Hadamard matrix is expressed in equation (2-2).

Referring to FIG. 3, the input ports of the WF demuxer 111 are referredto as wavefront components (wfcs), i.e. wfc1′, wfc2′, wfc3′, wfc4′,wfc5′, wfc6′, wfc7′ and wfc8′, and its output ports are slices, i.e.slice1′, slice2′, slice3′, slice4′, slice5′, slice6′, slice7′ andslice8′. In this example, the 8 input data sets 116, i.e. D′1-D′8, areconnected to its input ports wfc1′-wfc8′ of the WF demuxer 111,respectively. The five retrieved data sets 114, i.e. S′1-S′5, areconnected to its output ports, i.e. slice1′ through slice5′,respectively. The retrieved data sets 118, i.e. S′x, is connected to itsoutput port, i.e. slice 6. Each of the outputs or retrieved data sets114 and 118, i.e. S′1-S′5 and S′x, may be a linear combination of theinputs 116, i.e. D′1-D′8, each weighted by a corresponding weightingparameter. Each of the outputs or retrieved data sets 114 and 118, i.e.S′1-S′5 and S′x, contains information associated with all of the inputs116, i.e. D′1-D′8.

Referring to FIG. 3, the retrieved data set S′x will be used fordiagnostic to be compared with the known data set Sx. If the two datasets S′x and Sx are identical, it could mean no “leakages” come from theother 5 data sets, i.e. S1-S5, and the stored data sets D1-D8 may bedetermined not to be contaminated. As a result, the retrieved data sets114, i.e. S′1, S′2, S′3, S′4 and S′5, will be identified with highconfidence as the data sets 104, i.e. S1, S2, S3, S4, and S5,respectively. On the other hand, if the two data sets S′x and Sx are notidentical, it could mean there are “leakages” from the other 5 datasets, i.e. S1-S5, it is highly likely that one or more of the storeddata sets D1-D8 may be contaminated either in one or more of the storagesites 131-1 through 131-8 in the Cloud storage 130 or duringtransportation for the data sets D1-D8 from the WF muxer 101 to theCloud storage 130 or for the data sets D′1-D′8 from the Cloud storage130 to the WF demuxer 111. Further processing may be required to restorethe stored data. With only 5 unknown data sets, i.e. S′1-S′5, 8 linearcombinations, i.e. D′1-D″8, of the 5 unknown data sets, i.e. S′1-S′5,and the known diagnostic/authentication data set, i.e. S′x , it ispossible to identify and correct 3 contaminated ones from the 8 storeddata sets 117, i.e. D′1-D″8, via the 8 different but known linearcombinations, i.e. D′1-D″8,. The extra data sets shall be used forbetter survivability, better reliability, and better authentications.

Referring to FIG. 3, when the last two of the retrieved data sets 118,i.e. S′7, and S′8, feature data sets with zeros or negligibly smallnumbers, representing empty data sets, it could indicate that theretrieved data sets 114, i.e. S′1-S′S, are not been contaminated in thestorage sites 131-1 through 131-8 in the Cloud storage 130 or duringtransportation for the data sets D1-D8 from the WF muxer 101 to theCloud storage 130 or for the data sets D′1-D′8 from the Cloud storage130 to the WF demuxer 111. As a result, the retrieved data sets 114,i.e. S′1, S′2, S′3, S′4 and S′5, shall be identified with confidence asthe input data sets 104, i.e. S1, S2, S3, S4, and S5, respectively.These two ports slice7′ and slice8′ have the nearly identical functionsas the port slice6′ coupled to the data set S′6, except these two portsslice7′ and slice8′ do not require any knowledge ofdiagnostic/authentication data sets, and can be reserved for storageoperators/administrators who may not have needs to know about the storeddata sets 104 and 114, i.e. S1-S5 and S′1-S′5, and/or thediagnostic/authentication data sets, i.e. Sx and S′x, to determine ifthe retrieved data sets S′1-S′S are contaminated in the storage sites131-1 through 131-8 in the Cloud storage 130 or during transportationfor the data sets D1-D8 from the WF muxer 101 to the Cloud storage 130or for the data sets D′1-D′8 from the Cloud storage 130 to the WFdemuxer 111.

Referring to FIG. 3, the 8 separated database (storage) sites 131-1through 131-8 may be allocated for the storage of the respective eightdata sets D1-D8 muxed by the WF muxer 101 from the 5 sets of data sets,i.e. S1-S5. Even when only one of the 5 data sets 104, i.e. S4, are tobe muxed by the WF muxer 101 into the eight data sets D1-D8 to be storedin the distributed storage sites 131-1 through 131-8, the stored datasets D1-D8 in the 8 respective storage sites 131-1 through 131-8 wouldbe 8 linear combinations, each of which may be a linear combination ofthe input data set S4 multiplied by a weighting parameter in WFV4 andthe diagnostic data set Sx multiplied by another weighting parameter inWFV6, e.g. digital data of the painting of “running horses” as anexample. It would be feasible to make the stored data sets D1-D8 hard tobe detected by emphasizing or multiplying the weighting parameters inWFV6 for the diagnostic data set Sx, i.e. the digital data of thepainting of “running horses”, by a scalar or emphasizing factor, such asgreater than 2, 5, 10 or even 100, so as to become 2, 5, 10 or even 100times “stronger than those in WFV4” or 10 to 20 dB, before thediagnostic data set Sx weighted by the 8 emphasized weighting parametersin WFV6 are combined with the data sets S4 weighted by the 8 weightingparameters in WFV4 for the 8 respective linear combinations, i.e. D1-D8.This is a camouflaged process. Each of the weighting parameters in WFV6may have an absolute number greater than that of any one of theweighting parameters in WFV4 by 2 times, 5 times, 10 times or even 100times, for example. Accordingly, the 8 resulting data sets, i.e. D1-D8,would appear mainly with 8 nearly identical digital data paintings ofrunning houses with weak data sets of S4 “floating” on all 8 digitalhouse paintings. Because of the orthogonal data distributions among thedata storage sites 131-1 through 131-8, the retrieving process 120 mayseparate the (weaker) stored real data, i.e. S′4, from the camouflageddigital data of Chinese horse painting (strong signals), i.e. S′x, basedon the data sets D′1-D′8. Elements in FIG. 3 having the same referencenumber as those in FIGS. 1 and 1A may refer to those illustrated inFIGS. 1 and 1A.

FIG. 3A depicts of how to retrieve the stored data in a scenario thatonly 5 of the 8 stored data sets D′1-D′8 are available from the storagesites 131-1 through 131-8. As indicated in this example, the storagesites 131-1, 131-6 and 131-7 for the stored data sets D′1, D′6 and D′7are not accessible. Only the data sets D′2, D′3, D′4, D′5 and D′8 areaccessible from the storage sites 131-2, 131-3, 131-4, 131-5 and 131-8and retrievable via Internet, such as the retrieval path. There are manydifferent combinations of taking 5 sets of data 117 from the 8 data setsD′1-D′8 in the 8 respective data storage sites 131-1 through 131-8. Inthis case, there are 56 possible combinations of availabilities. Themodified WF muxer 111 a shall be designed to handle all possiblecombinations. The unavailability of the stored data sets, i.e. D′1, D′6and D′7 in this case, may be caused by physical damages of the sites,electronic upsets on the data contents, sabotaged by hackers, and/or byother causes. Elements in FIG. 3A having the same reference number asthose in FIGS. 2A, 2B and 3 may refer to those illustrated in FIGS. 2A,2B and 3.

Alternatively, referring to FIG. 3, the WF multiplexing 101 techniquesmay be used to multiplex the 5 sets of data 104, i.e. S1, S2, S3, S4 andS5, and the diagnostic/authentication data set Sx into the eight outputdata sets D1-D8 to be transmitted via Internet and then to be storedrespectively in the 8 physically separated data storage sites 131-1through 131-8 in the IP Cloud 130. The first three data sets, i.e. S1,S2, and S3, are generated by segmenting a large data set U1, as seen inFIG. 2A, by a segmentation processor 102. After the 5 sets of data 114,i.e. S′1-S′5, are retrieved by the WF demuxer 111 from all of the datasets D′1-D′8 transmitted from the 8 storage sites 131-1 through 131-8,the first 3 retrieved data sets, i.e. S′1, S′2, and S′3, may be groupedinto a large data set U′1, as seen in FIG. 2B, via a de-segmentationprocessor 112.

Alternatively, referring to FIG. 3A, the WF muxing techniques 101 may beused to multiplex the 5 sets of data 104, i.e. S1, S2, S3, S4 and S5,and the diagnostic/authentication data set Sx into the eight output datasets D1-D8 to be transmitted via Internet and then to be storedrespectively in the 8 physically separated data storage sites 131-1through 131-8 in the IP Cloud 130. The first three data sets, i.e. S1,S2, and S3, are generated by segmenting a large data set U1, as seen inFIG. 2A, by a segmentation processor 102. After the 5 sets of data 114,i.e. S′1-S′S, are retrieved by the WF demuxer 111 from only five, e.g.D′2, D′3, D′4, D′S and D′8, of the data sets D′1-D′8 stored in the 8storage sites 131-1 through 131-8 when only 5 stored data sets 117 a,e.g. D′2, D′3, D′4, D′S and D′8, are accessible. After the 5 sets ofdata 114, i.e. S′1-S′S, are retrieved by the WF demuxer 111 a from thefive data sets, e.g. D′2, D′3, D′4, D′5 and D′8, transmitted from the 5respective storage sites 131-2, 131-3, 131-4, 131-5 and 131-8, the first3 retrieved data sets, i.e. S′1, S′2, and S′3, may be grouped into alarge data set U′1, as seen in FIG. 2B, via a de-segmentation processor112.

The following two embodiments are related to data structures usingwavefront multiplexing for video streaming via multiple mirroring sites.With the explosive growth of video applications over the Internet, manyapproaches have been proposed to stream video effectively over packetswitched best-effort networks. In present invention, we propose a datastructure based on wavefront multiplexing (WF muxing) for simultaneousvideo streaming from multiple senders to a single receiver in order toachieve higher throughput, and to increase tolerance to packet loss anddelay due to network congestion. Our data structures will work protocolswith rate allocation scheme and packet partition algorithm. The rateallocation scheme, run at the receiver, determines the sending rates forindividual sender by taking into account available network bandwidth,channel characteristics, in such a way as to minimize the probability ofpacket loss. The packet partition algorithm, run at the senders based ona set of parameters estimated by the receiver, ensures that a group ofpackets with built-in redundancies are sent by various sendersconcurrently, and at the same time, minimizes the startup delay.

Wavefront multiplexing/demultiplexing (WF muxing/demuxing) processfeatures an algorithm for satellite communications where transmissionsdemand a high degree of power combining, security, reliability, andoptimization. The WF muxing/demuxing, embodying architectures utilizingmulti-dimensional transmissions, have found applications in fieldsbeyond the satellite communication domain. One such application is datastorage on cloud where privacy and redundancy are important for datatransports and storage.

Acoustic Signal Analogy for Wavefront Muxing/Demuxing

Referring to FIG. 4A, when there are three singers 401, 402, and 403,singing different songs, each of them will have his/her songs recordedseparately and his/her own audio data stored individually, as shown inFIG. 4A. The conventional way of recording a song is to place amicrophone 411, 412 or 413 very close to a vocalist's mouth, recordher/his singing and then store the digital audio data S1, S2, or S3 on astorage device 421, 422, or 423. Consequently, each storage site onlyfeatures recorded acoustic data from one of the three vocalists 401, 402and 403. When various audience groups want to listen to songs from thethree different vocalists, the recorded audio data will be retrievedfrom different storage site and played accordingly by various speakers431, 432, and 433.

With WF muxing techniques, the methods of recording and storing would bedifferent. Again, there are three vocalists, 401, 402, and 403, singingthree different songs concurrently, as depicted in FIG. 4B. Then, wewould use five different microphones 411,412, 413, 414, and 415, each ofwhich links to a corresponding one of storage devices 421, 422, 423, 424and 425, to receive the audio data sets S1-S3, spatially aggregated,from the three singers 401, 402 and 403, i.e. sound sources. Theaggregated audio data sets may sound simply as “noise”. The threevocalists 401, 402 and 403, in this example, stand in a first line withabout one meter between 401 and 402, and about two meters between 402and 403. Alternatively, a distance between mouths of neighboring two ofthe singers 401, 402 and 403 may range from 30 cm to 50 m or from 50 cmto 10 m. The five microphones 411-415, facing the vocalists, are placedin a second line, which is about three meters away from the first line.Alternatively, a distance between the first and second lines may rangefrom 50 cm to 50 m or from 2 m to 20 m. The spacing between adjacentmicrophones is approximately 1/10 of a meter. A distance between centersof neighboring two of the microphones 411-415 may range from 5 cm to 10m or from 10 cm to 1 m. When recording concurrently, each of themicrophones 411-415 picks up or receives voices from all three vocalists401, 402 and 403.

Referring to FIG. 4B, because each neighboring two of the fivemicrophones 411-415 may be placed in a different space or distance fromother neighboring two of the five microphones 411-415 and eachneighboring two of the three vocalists 401, 402 and 403 may bepositioned in a different space or distance from other neighboring twoof the three vocalists 401, 402 and 403, an audio stream S1, S2 or S3from each of the singers 401, 402 and 403 transmits to the fivemicrophones 411-415 with particular time delays. A “wavefront” or WF isthus formed by acoustic wave propagation with the time delays in aparticular geometry (i.e., in this instance, a position of one of thevocalists 401-403 relative to that of each of the five microphones411-415, and relative to that of the other of the vocalists 401-403).Consequently, with respect to one of the vocalists 401-403, the fivemicrophones 411-415 “spatially” sample and record a unique wavefront ofacoustic waves S1, S2 or S3 propagated from said one of the vocalists401-403. The three unique acoustic wavefronts S1-S3 originateddistinctively from the vocalists 401, 402 and 403 are aggregated byaudio propagation in free space, spatially sampled by the fivemicrophones 411-415 into five sampled data sets D1-D5 to be stored infive respective storage sites or devices 421-425. The acoustic data setsS1-S3 are spatially aggregated to be recorded via the 5 microphones411-415 spatially sampling and recording wavefronts of the aggregationof the acoustic data sets S1-S3 concurrently.

The above aggregation process may be considered as “wavefrontmultiplexing or WFM”, and the aggregated acoustic data sets D1-D5 may beconsidered as WF “muxed” audio data.

The memory size required for storing a single vocal stream from avocalist may be identical to that for the aggregated acoustic data setsD1-D5, each of which is a linear combination of the acoustic waves fromthe three vocalists 401, 402 and 403. Also, as mentioned before, if aperson listens to one of the aggregated audio data sets D1-D5, theperson may hear an audio “noise” composed of the three incoherentacoustic waves concurrently generated from the three vocalists 401, 402and 403.

Referring to FIG. 4B, when various audience groups want to listen tosongs from the three individual vocalists 401, 402 and 403, three audiodata sets S′1-S′3 may be retrieved by a postprocessor 440 from all ofthe five aggregated acoustic data sets D1-D5 stored in the 5 respectivestorage sites 421, 422, 423, 424 and 425, and then may be playedaccordingly by three speakers 431, 432 and 433 respectively. Thepost-processor 440 will use information of various time delays of theacoustic data sets S1-S3 from 3 vocalists 401, 402 and 403 to 5different microphones 411, 412, 413, 414 and 415 to unscramble songs,i.e. the acoustic data sets S1-S3, from the 3 individual vocalists401-403. It is a reversing process of WF muxing (WFM), and each of thethree singers' audio streams or data sets S′1-S′3, substantiallyequivalent to the acoustic data sets S1-S3 respectively, may beindividually retrieved and reconstituted from the aggregated data setsD1-D5 stored in respective storage sites 421-425 via an inversedwavefront transformation referred to as “wavefront demultiplexing or WFMdemux”. The wavefront demuxer 440 may generate outputs or acoustic datasets S′1-S′3, each of which may be a linear combination of the inputs ofthe wavefront demuxer 440, i.e. aggregated data sets D1-D5, eachweighted by a corresponding weighting parameter, which may be a complexnumber. Each of the outputs or acoustic data sets S′1-S′3 containsinformation associated with all of the inputs of the wavefront demuxer440, i.e. aggregated data sets D1-D5. Furthermore, before stored in therespective storage sites 421-421, the acoustic aggregated data setsD1-D5 are may be amplified by five amplifiers 426. Functionally, theyare no more than a beam forming processing for orthogonal beams (OB) asdepicted in FIG. 4C. Post processing functions may be provided by amulti-beam beam former, i.e. WF demuxer 440, accompanying with the 5microphones 411-415 arranged in an acoustic array, generating threeorthogonal beams S′1-S′3 concurrently.

In this example, referring to FIGS. 4B-4D, the three vocalists 401-403are almost in a far field of the acoustic array with 5 microphones411-415 distributed over a linear dimension about 0.5 m. Far fields ofthe acoustic array for an acoustic wave at 1 KHz are about 3 m away fromthe second line where the 5 microphones 411-415 are arranged. Thevocalists 401-403 are 3 meters in front of the acoustic array.

Referring to FIGS. 4B-4D, orthogonal beams (OB) are a group of beamspointing to various directions with unique features that a peak of onebeam is always at nulls of all other orthogonal beams. For example, theorthogonal beam S′1 has a beam peak at nulls of the orthogonal beams S′2and S′3. The receiving linear acoustic array with 5 microphones 411-415is used to form three OB beams S′1-S′3 concurrently via a digital beamforming (DBF) processing performed by the WF demuxer 440. FIG. 4E showsa first orthogonal beam S′1 in accordance with the present invention.For real time operation, the first orthogonal beam S′1 features anacoustic pattern with a beam peak at a gain of about 9 dBi pointed tothe singer 401, a first null at a gain of about −25 dBi pointed to thesinger 402 and a second null at a gain of about −25 dBi pointed to thesinger 403. As a result, the first orthogonal beam S′1 shall enhance theexpression of the acoustic data set S1 since the acoustic data sets S2and S3 are nulled out by the DBF processing performed by the WF demuxer440. The first orthogonal beam S′1 at an output of the WF demuxer 440may enhance gain in the direction of the performer 401 by about 7 dBenhancement on a signal-to-noise ratio (SNR) and concurrently suppressgain in the directions of the performers 402 and 403 by more thanbetween 20 and 40 dB relative to the gain in the direction of theperformer 401. Accordingly, there is an isolation or difference ofgreater than 30 dB in the beam S′1 between the enhanced acoustic dataset from the performer 401 and the suppressed undesired acoustic dataset from one of the other two performers 402 and 403. The audio data setS′1 may be played via the first speaker 431 receiving the firstorthogonal beam S′1.

FIG. 4F shows a second orthogonal beam S′2 in accordance with thepresent invention. Referring to FIG. 4F, the second orthogonal beam S′2features an acoustic pattern with a beam peak P2 at a gain of about 9dBi pointed to the singer 402, a first null N1 at a gain of about −25dBi pointed to the singer 401 and a second null N3 at a gain of about−25 dBi pointed to the singer 403. As a result, the second orthogonalbeam S′2 shall enhance the expression of the acoustic data set S2 sincethe acoustic data sets S1 and S3 are nulled out by the DBF processingperformed by the WF demuxer 440. The second orthogonal beam S′2 at anoutput of the WF demuxer 440 may enhance gain in the direction of theperformer 402 by about 7 dB enhancement on a signal-to-noise ratio (SNR)and concurrently suppress gain in the directions of the performers 401and 403 by more than between 20 and 40 dB relative to the gain in thedirection of the performer 402. Accordingly, there is an isolation ordifference of greater than 30 dB in the beam S′2 between the enhancedacoustic data set from the performer 402 and the suppressed undesiredacoustic data set from one of the other two performers 401 and 403. Theaudio data set S′2 may be played via the second speaker 432 receivingthe second orthogonal beam S′2.

FIG. 4G shows a third orthogonal beam S′3 in accordance with the presentinvention. Referring to FIG. 4G, the third orthogonal beam S′3 featuresan acoustic pattern with a beam peak P3 at a gain of about 9 dBi pointedto the singer 403, a first null N1 at a gain of about −25 dBi pointed tothe singer 401 and a second null N2 at a gain of about −25 dBi pointedto the singer 402. As a result, the third orthogonal beam S′3 shallenhance the expression of the acoustic data set S3 since the acousticdata sets S1 and S2 are nulled out by the DBF processing performed bythe WF demuxer 440. The third orthogonal beam S′3 at an output of the WFdemuxer 440 may enhance gain in the direction of the performer 403 byabout 7 dB enhancement on a signal-to-noise ratio (SNR) and concurrentlysuppress gain in the directions of the performers 401 and 402 by morethan between 20 and 40 dB relative to the gain in the direction of theperformer 403. Accordingly, there is an isolation or difference ofgreater than 30 dB in the beam S′3 between the enhanced acoustic dataset from the performer 403 and the suppressed undesired acoustic dataset from one of the other two performers 401 and 402. The audio data setS′3 may be played via the second speaker 433 receiving the secondorthogonal beam S′3.

For the analogy of data storage depicted in Error! Reference source notfound.D, the wavefronts from the three performers 401-403 are aggregatedin the free space to be received by the microphones 411-415. Themicrophones 411-415 may generate the five aggregated acoustic data setsD1-D5 to be stored respectively in the five storage sites 421, 422, 423,424 and 425. Alternatively, the wavefront multiplexed acoustic data setsD1-D5 may be stored in five respective local folders, at a transmittingsite, synchronized automatically in series with the five storage ormirror sites 421-425 in IP cloud, which may be provided by differentcloud storage providers respectively, via Internet. Furthermore,multiple links linking to the five acoustic data sets D1-D5 stored inthe five respective data storage or mirror sites 421-425 may be passedto one or more of the storage or mirror sites 421-425 and/or stored inthe transmitting site. The wavefront multiplexed acoustic data setsD1-D5 may be transmitted to the WF demuxer 440 to form the threeorthogonal beams S′1-S′3, as illustrated in FIGS. 4C-4G. Alternatively,the WF demuxer 440 may receive the acoustic data sets D1-D5 fromseparated local folders, i.e. memory sets in a local memory device at areceiving site, synchronized automatically in series with the 5respective storage or mirror sites 421-425 in IP Cloud storage viaInternet optionally in accordance with the links passed from one or moreof the storage or mirror sites 421-425 or transmitting site to thereceiving site.

It is important to note that the three retrieved audio streams S′1, S′2and S′3 derive from a common set of the five stored WF muxed data setsD1-D5. Conceivably, a common set of these 5 WF muxed data D1-D5 may beWF demuxed into three retrieved audio streams S′1, S′2 and S′3 to beefficiently multicast to three groups of audiences independently butconcurrently with some delivering redundancies via Internet or IP cloud.

Redundancies built in the acoustic receiving array, which means thenumber of the microphones, e.g. the 5 microphones 411-415 in thisembodiment, is greater than that of the performers, e.g. the 3 singers401-403 in this embodiment, provide many advantages including gracefuldegradations. In this particular instance, the acoustic data set S′1-S′3from each singer's own independent audio stream can be retrieved andreconstituted from any three of the five stored aggregated audio datasets D1-D5 stored in the 5 storage sites 421, 422, 423, 424 and 425. Theremaining two of the aggregated audio data sets D1-D5 thus serves as aredundancy (or backup) for the three acoustic data sets S1, S2 and S3.

It is important to notice that the redundancy in wavefront multiplexingis for the three acoustic data sets S1, S2 and S3. Redundancies are“shared” for the three acoustic data sets S1, S2 and S3. The redundantdata, i.e. the remaining two of the aggregated audio data sets D1-D5,appears themselves as aggregated noises. As an example of calculatingdata survivability, the WF muxing technique to assure survivability of99.9% over next month will require a memory service provider with 5×storages for 3× size of data with a 90% data survivability of a singlestorage (reliability of the storage devices) over the next month. On theother hand, a conventional brute force technique, RAID 1 (mirroring), toassure data survivability of 99.9% over next month will require the samememory service provider with 3× storages for X size of data with a 90%survivability of a single storage (reliability of the storage devices)over the next month. Brute force techniques (such as RAID 1) shallrequire 9× memories for 3× data to achieve the same survivability asthose from a WF muxing technique which only needs 5× memories for 3×data.

The acoustic wave propagation phenomena in this example, in whichvarious wavefronts are concurrently generated, can always be replicatedin computers “mathematically”. Only some selected geometries linking thevocalists 401 to 403 and microphones 411 to 415 may be easily formulatedvia orthogonal transformations such as Fourier transform, Hadamardtransform, and etc. On the other hand, not all the orthogonaltransformations generating various orthogonal wavefronts for distributeddata storages can be analogized to a simple geometry linking vocalistsand microphones by acoustic wave propagations.

Referring to FIGS. 4C and 4D, it is also true that to form orthogonalbeams may not need beam former representable by orthogonal matrices. Asillustrated in this example in which the acoustic array shall form threeOB beams S′1-S′3 with 5 receiving elements 411-415, the beam formingmechanisms performed by the WF demuxer 440 shall be characterized, ingeneral by a 3*5 matrix for multiplying the aggregated acoustic data setof [D1, D2, D3, D4, D5]^(T). Many subsets of 3*3 matrices degeneratedfrom the 3*5 matrix are not orthogonal matrices. Their inverse matricesare not themselves.

From array antenna points of view, the first OB beam S′1 is formed by 5receiving elements 411-415, which feature 5 degrees of freedom but onlyconstrained by 3 directions, i.e. a beam peak P1 in the direction of theperformer 401, a first beam null N2 in the direction of the performer402, and a second null N3 in the direction of the performer 403, as seenin FIG. 4E. Similarly, the second and the third OB beams S′2 and S′3 arerespectively generated by the same 5 receiving elements 411-415 (5degrees of freedom) and two different sets of 3 directional constraints,as seen in FIGS. 4F and 4G. These beam form networks are characterizedby 3 simultaneous but independent linear equations with 5 variables.

Orthogonal matrices are sufficient conditions for forming orthogonalbeams. They are overly constrained requirements. In this inventionapplication, we use square matrices, i.e. Hadamard matrix, with fullranks for WF muxing and demuxing performed by the WF muxer 101 and WFdemuxer 111, 111 a or 440 as illustrated in FIGS. 1-4D; these matricesmay be orthogonal, and may not be orthogonal. However, orthogonalmatrices offer some unique features which may be advantageous forcertain applications.

FIGS. 5A, 5B, 5C, 5D and 5E illustrate data privacy for storage andtransport on cloud. In imaging processing simulations, we use “pixelintensity” of images as means for linear combinations, presenting how togenerate WF muxed data from multiple original image data sets to bestored on cloud, and how to reconstitute multiple original data fromstored datasets on cloud. The headers and trailers of the digital imagefiles are not included in simulations.

Two image processing software functions in Matlab are utilized, ‘imread’and ‘imwrite’. The function ‘imread’ imports images from the originalgraphical files. The function ‘imwrite’ converts the wavefrontmultiplexed and recovered images to graphics. Pixel dimensions among theinput images are “equalized” so that they feature same pixel dimensions.In addition, double precision arithmetic is implemented to avoidoverflow and underflow on numerically positive image data for both WFmuxing/demuxing process. As a result, the WF muxed data is not minimizedin size.

FIG. 5A depicts secured storage and transport of utility bills on smartgrid via WF muxing/demuxing or orthogonal transformations. FIG. 5Adepicts the original inputs in the first row, stored images in wavefrontmuxed formats in the second row, and reconstituted and recovered imagesin the third row, respectively.

First row shows 4 original images. Second and third rows depict,respectively, 4 Wavefront muxed image, and 4 recovered images.

The four pictures on the top row of FIG. 5A are the four input images;an image of a classic painting, a “Running Horse”, by a famous Chinesepainter Mr. Xu Beihong in 1930's, and 3 utility bills. They arerepresented in Portable Network Graphics (PNG) format. Their pixel sizesin a rectangular lattice format are summarized in the first three rowsof Table 1, ranging from 1280 to 1565 in one dimension and 621 to 890 inthe other dimension. The data sets A1, A2, A3, and A4 may be fullyequalized in pixel dimensions into 4 respective data sets A1 e, A2 e, A3e, and A4 e in a lattice format of 1595*890 for pixels with respectiveintensities, wherein the equalized images A1 e-A4 e may have the numberof rows, equal to or greater than the largest number of rows among theoriginal images A1-A4, and the number of column, equal to the largestnumber of columns among the original images A1-A4.

Referring FIG. 5A, the WF muxing/demuxing transformations on pixellevels are pixel-by-pixel operations. One formulation for the concurrentpixel level operations on these 4 images including the 4 pictures is toselect a pixel, e.g. in the 110^(th) column and the 23^(rd) raw, from alattice position, (xi, yj), of the four pixel matrices of the fourequalized images, i.e. A1 e, A2 e, A3 e, and A4 e. The intensities ofthe selected 4 input pixels, are represented as ∥A∥.

TABLE 1 comparisons of image dimensions and sizes Originals in PNG filesA1.png A2.png A3.png A4.png Dimensions 1280 × 890 1565 × 810 1504 × 6871595 × 621 Size 1.20 MB 1.52 MB 1.34 MB 1.38 MB WF Muxed PNG filesOv.png Ox.png Oy.png Oz.png Dimensions 1595 × 890 1595 × 890 1595 × 8901595 × 890 Size 4.78 MB 4.78 MB 4.78 MB 4.78 MB Recovered PNG filesSv.png Sx.png Sy.png Sz.png Dimensions 1280 × 890 1565 × 810 1504 × 6871595 × 621 Size 1.20 MB 1.52 MB 1.34 MB 1.38 MB

Referring to FIG. 5A, a “writing” processing features two steps: thefirst step is a pixel-by-pixel operation converting intensities ofpixels on a specified lattice (xi, yj) location of the four pictures,i.e. A1 e-A4 e, in ∥A˜ into 4 aggregated intensities of 4 WF muxedpixels and place 4 aggregated intensities of the 4 WF muxed pixels atthe specified lattice location (xi, yj) in the four respective WF muxedfiles Ov, Ox, Oy and Oz in ∥O∥, via the following transformation:

$\begin{matrix}{{O} = {{{WMux}}\mspace{14mu} {A}}} & \left( {11a} \right) \\{{{where}\text{:}\mspace{14mu} {O}} = \begin{bmatrix}{O\; v} \\{O\; x} \\{O\; y} \\{O\; z}\end{bmatrix}} & \left( {11a\text{-}1} \right) \\{{{WMux}} = \begin{bmatrix}{+ 1} & {+ 1} & {+ 1} & {+ 1} \\{+ 1} & {- 1} & {+ 1} & {- 1} \\{+ 1} & {+ 1} & {- 1} & {- 1} \\{+ 1} & {- 1} & {- 1} & {+ 1}\end{bmatrix}} & \left( {11a\text{-}2} \right) \\{{A} = \begin{bmatrix}{A\; 1\; e} \\{A\; 2\; e} \\{A\; 3\; e} \\{A\; 4\; e}\end{bmatrix}} & \left( {11a\text{-}3} \right)\end{matrix}$

Referring to FIG. 5A, “intensities” of individual pixels, in the latticeof the same row and column, of the 4 WF muxed files, i.e. Ov, Ox, Oy andOz, are 4 respective linear combinations, each of which is a linearcombination of intensities of individual pixels, in the lattice of thesame row and column, of the 4 equalized files, i.e. A1 e, A2 e, A3 e andA4 e, ∥A∥, multiplied by four respective weighting parameters in ∥WMux∥.Four weighting parameters for multiplying one of the data sets A1 e-A4e, such as the data set A1 e with an image of a horse, may have anidentical absolute value greater than another identical absolute valueof four other weighting parameters for multiplying another one of thedata sets A1 e-A4 e, such as the data set A2 e, A3 e or A4 e, by ascalar or emphasizing factor such as greater than two, five, ten or evenone hundred. For example, “intensities” of individual pixels, in thelattice of the 41^(th) row and 51^(th) column, of the 4 WF muxed files,i.e. Ov, Ox, Oy and Oz, are 4 respective linear combinations, each ofwhich is a linear combination of intensities of individual pixels, inthe lattice of the 41^(th) row and 51^(th) column, of the 4 equalizedfiles, i.e. A1 e, A2 e, A3 e and A4 e, in ∥A∥, multiplied by fourrespective weighting parameters in ∥WMux∥. The selected 4*4 matrix,∥WMux∥, is a Hadamard matrix with a rank of 4.

Referring to FIG. 5A, the second step involves transporting the 4 WFmuxed files individually to different data storages on smart grid or to4 respective local folders, at a transmitting site, synchronizedautomatically in series with 4 storage or mirror sites in IP cloud,which may be provided by different cloud storage providers respectively,via Internet. Furthermore, multiple links linking to the four data setsstored in the four respective data storage or mirror sites may be passedto one or more of the respective storage or mirror sites and/or storedin the transmitting site. Some of the WF muxed data sets, i.e. Ov, Ox,Oy and Oz, may be also stored locally at the transmitting site. The 4pictures in the second raw in FIG. 5A are the images of the 4 WF muxedfiles, i.e. Ov, Ox, Oy and Oz, displayed through a conventional pngimage display. Their sizes are summarized in second three rows inTable 1. It appears that these WF muxed images exhibit features of“horse” with appearances of low brightness, there are no traces of other3 images at all.

Referring to FIG. 5A, the images on the third row are restructuredimages via a reading process. A “reading” processing also features twosteps. The first step involves retrieving all 4 WF muxed filesindividually from various data storage on smart grid or from 4 separatedlocal folders, i.e. memory sets in a local memory device at a receivingsite, synchronized automatically in series with the 4 respective storageor mirror sites in IP Cloud storage via Internet optionally inaccordance with the links passed from the respective storage or mirrorsites or transmitting site to the receiving site. The second stepinvolves via a wavefront demultiplexing transformation, converting the 4WF muxed files, i.e. Ov, Ox, Oy and Oz, in ∥O∥ into four recovered orreconstituted equalized files Sve, Sxe, Sye and Sze in ∥S∥ substantiallyequivalent to the four equalized pictures A1 e-Ae4 respectively if theWF muxed files, i.e. Ou, Ov, Ox, Oy and Oz, are not contaminated. Thefour recovered or reconstituted equalized image files Sve, Sxe, Sye andSze may then be converted via a de-equalizing process into fourrecovered or reconstituted image files Sv, Sx, Sy and Sz substantiallyequivalent to the four original pictures A1-A4 respectively. Assumingall four files Ov, Ox, Oy and Oz are available, the WF demuxingtransformation (WF demuxing) shall follow: ∥S∥=∥WDmx∥ ∥O∥. Furthermore,∥WDmx∥∥WMux∥=∥I∥. More explicitly, “intensities” of individual pixels,in the lattice of the same row and column, of the 4 reconstituted imagesin Sve, Sxe, Sye and Sze in ∥S∥ are 4 respective linear combinations,each of which is a linear combination of intensities of individualpixels, in the lattice of the same row and column, of the four WF muxedfiles, i.e. Ov, Ox, Oy and Oz, in ∥O∥, multiplied by four respectiveweighting parameters in ∥WDmx∥. Five weighting parameters, multiplyingthe WF muxed files, i.e. Ov, Ox, Oy and Oz, in ∥O∥, for obtaining theemphasized one of the data sets Sve, Sxe, Sye and Sze, such as the dataset Sve with an image of a horse, may have an identical absolute valueless than another identical absolute value of four weighting parameters,multiplying the WF muxed files, i.e. Ov, Ox, Oy and Oz, in ∥O∥, forobtaining another one of the data sets Sve, Sxe, Sye and Sze, such asthe data set Sxe, Sye or Sze, by a scalar or contracting factor such asgreater than two, five, ten or even one hundred. The contracting factormay be equal to a reciprocal of the emphasizing factor. For example,“intensities” of individual pixels, in the lattice of the 41^(th) rowand 51^(th) column, of the 4 reconstituted or recovered images in Sve,Sxe, Sye and Sze in ∥S∥ are 4 respective linear combinations, each ofwhich is a linear combination of intensities of individual pixels, inthe lattice of the 41^(th) row and 51^(th) column, of the four WF muxedfiles, i.e. Ov, Ox, Oy and Oz, in ∥O∥, multiplied by four respectiveweighting parameters in ∥WDmx∥.

In order to assure that the A1 image of the Chinese horse painting to bemore dominant features in the 4 multiplexed outputs as camouflaged, wehave emphasized the pixel intensities of A1 via:

$\begin{matrix}{\begin{bmatrix}{O\; 1} \\{O\; 2} \\{O\; 3} \\{O\; 4}\end{bmatrix} = {\begin{bmatrix}{+ 1} & {+ 1} & {+ 1} & {+ 1} \\{+ 1} & {- 1} & {+ 1} & {- 1} \\{+ 1} & {+ 1} & {- 1} & {- 1} \\{+ 1} & {- 1} & {- 1} & {+ 1}\end{bmatrix}\begin{bmatrix}{M*A\; 1\; e} \\{A\; 2e} \\{A\; 3\; e} \\{A\; 4\; e}\end{bmatrix}}} & \left( {11b} \right)\end{matrix}$

where M>1. Usually M is set to be greater than 10. Depending on theselection of a camouflaging image, the emphasizing factor, M, mayapplied to any of the input images in ∥A∥. Furthermore, equation (11b)may also be written equivalently as:

$\begin{matrix}{\begin{bmatrix}{O\; 1} \\{O\; 2} \\{O\; 3} \\{O\; 4}\end{bmatrix} = {\begin{bmatrix}{+ M} & {+ 1} & {+ 1} & {+ 1} \\{+ M} & {- 1} & {+ 1} & {- 1} \\{+ M} & {+ 1} & {- 1} & {- 1} \\{+ M} & {- 1} & {- 1} & {+ 1}\end{bmatrix}\begin{bmatrix}{A\; 1\; e} \\{A\; 2\; e} \\{A\; 3\; e} \\{A\; 4\; e}\end{bmatrix}}} & \left( {11b\text{-}1} \right)\end{matrix}$

FIG. 5B depicts WF muxed image processing with a 5-for-4 redundancy instored images and image transport. The first row and the third row,respectively, depict the same 4 sets of images as those in FIG. 5A. Onthe other hand, there are 5 image displays with a setting of “lowbrightness” of the “horse” painting in the middle row. The WFmuxing/demuxing transformations are pixel-by-pixel operations. Oneformulation for the concurrent pixel level operations on these 5 imagesincluding selecting intensities of pixels at an identical latticeposition, (xi, yj), e.g. the 110^(th) column and the 23^(rd) raw, fromthe five pixel matrices of the equalized data sets, A1 e, A2 e, A3 e, A4e, and A5 e, wherein the equalized images A1 e-A4 e may have the numberof rows, equal to or greater than the largest number of rows among theoriginal images A1-A4, and the number of column, equal to the largestnumber of columns among the original images A1-A4. The equalized imageA5 e is a matrix of pixels with the same dimensions of 1590*890, buteach of the pixels in the equalized image A5 e has an intensity value of“0”. The intensities of the selected 5 input pixels are represented by∥A′∥.

Referring to FIG. 5B, a “writing” processing features two steps. Thefirst step is to convert intensities of pixels on a specified lattice(xi, yj) location from the four pictures, i.e. A1 e-A4 e, and thepicture A5 e with pixels of “zero” intensity in ∥A′∥ via the followingwavefront multiplexing transformation into 5 aggregated intensities of 5WF muxed pixels, and then place the 5 aggregated intensities of the 5 WFmuxed pixels at the specified lattice location (xi, yj) in the fiverespective MF muxed files Ou, Ov, Ox, Oy and Oz in ∥O∥.

$\begin{matrix}{{O} = {{{WMux}}\mspace{14mu} {A^{\prime}}}} & (12) \\{{{Where}:\mspace{14mu} {O}} = \begin{bmatrix}{O\; u} \\{Ov} \\{Ox} \\{Oy} \\{Oz}\end{bmatrix}} & \left( {12a} \right) \\{{{WMux}} = \begin{bmatrix}{+ 1} & {+ 1} & {+ 1} & {+ 1} \\{+ 1} & {- 1} & {+ 1} & {- 1} \\{+ 1} & {+ 1} & {- 1} & {- 1} \\{+ 1} & {- 1} & {- 1} & {+ 1} \\{+ 1} & {+ 1} & {+ 1} & {- 1}\end{bmatrix}} & \left( {12b} \right) \\{{A^{\prime}} = \begin{bmatrix}{A\; 1\; e} \\{A\; 2\; e} \\{A\; 3\; e} \\{A\; 4\; e} \\{A\; 5e}\end{bmatrix}} & \left( {12c} \right)\end{matrix}$

Referring to FIG. 5B, the “intensities” of individual pixels, in thelattice of the same row and column, of the 5 WF muxed files, i.e. Ou,Ov, Ox, Oy and Oz, are 5 respective linear combinations, each of whichis a linear combination of intensities of individual pixels in the samerow and column of the lattice of the 5 equalized files, i.e. A1 e, A2 e,A3 e, A4 e and A5 e, ∥A∥, multiplied by five respective weightingparameters in ∥WMux∥. Five weighting parameters for multiplying one ofthe data sets A1 e-A5 e, such as the data set A1 e with an image of ahorse, may have an identical absolute value greater than anotheridentical absolute value of five other weighting parameters formultiplying another one of the data sets A1 e-A5 e, such as the data setA2 e, A3 e or A4 e, by a scalar or emphasizing factor such as greaterthan two, five, ten or even one hundred. For example, “intensities” ofindividual pixels, in the lattice of the 41^(th) row and 51^(th) column,of the 5 WF muxed files, i.e. Ou. Ov, Ox, Oy and Oz, are 5 respectivelinear combinations, each of which is a linear combination ofintensities of individual pixels, in the lattice of the 41^(th) row and51^(th) column, of the 5 equalized files, i.e. A1 e, A2 e, A3 e, A4 eand A5 e, in ∥A∥, multiplied by five respective weighting parameters in∥WMux∥.

The second step involves transporting the 5 WF muxed files, i.e. Ou. Ov,Ox, Oy and Oz, individually to 5 respective data storage sites on cloudor to 5 respective local folders, at a transmitting site, synchronizedautomatically in series with 5 respective data storage or mirror sitesin IP cloud, provided by different cloud storage providers respectively,via Internet. Furthermore, multiple links linking to the five data setsstored in the five respective data storage or mirror sites may be passedto the respective storage or mirror sites and/or stored in thetransmitting site. Some of the 5 WF muxed data sets, i.e. Ou. Ov, Ox, Oyand Oz, may be also stored locally at the transmitting site. The 5pictures on the second raw are corresponding images of the 5 WF muxedfiles, i.e. Ou. Ov, Ox, Oy and Oz in ∥O∥, displayed through aconventional png image display.

Referring to FIG. 5B, the images on the third row are restructuredimages via a reading process. A “reading” processing also features twosteps. The first step involves retrieving any four or all of the 5 WFmuxed files, i.e. Ou, Ov, Ox, Oy and Oz, derived from 5 separated localfolders, i.e. memory sets in a local memory device at a receiving site,synchronized automatically in series with the 5 respective storage ormirror sites in IP Cloud storage via Internet optionally in accordancewith the links passed from the respective storage or mirror sites ortransmitting site to the receiving site. The second step involves via awavefront demultiplexing transformation, converting any four or all ofthe WF muxed files, i.e. Ou, Ov, Ox, Oy and Oz, in ∥O∥ into fourrecovered or reconstituted equalized image files Sve, Sxe, Sye and Szein ∥S∥ substantially equivalent to the four equalized pictures A1 e-Ae4respectively if the WF muxed files, i.e. Ou, Ov, Ox, Oy and Oz, are notcontaminated. The four recovered or reconstituted equalized image filesSve, Sxe, Sye and Sze may then be converted via a de-equalizing processinto four recovered or reconstituted image files Sv, Sx, Sy and Sz∥S∥substantially equivalent to the four original pictures A1-A4respectively. Assuming four of the five files Ou, Ov, Ox, Oy and Oz areavailable, the WF demuxing transformation (WF demuxing) shall follow:∥S∥=∥WDmx∥ ∥O∥. Furthermore, ∥WDmx∥ ∥WMux∥=∥I∥. More explicitly,“intensities” of individual pixels, in the lattice of the same row andcolumn, of the 4 reconstituted images in Sve, Sxe, Sye and Sze in ∥S∥are 4 respective linear combinations, each of which is a linearcombination of intensities of individual pixels in the same row andcolumn of the lattice of the available four of the WF muxed files, i.e.Ou, Ov, Ox, Oy and Oz, in ∥O∥, multiplied by four respective weightingparameters in ∥WDmx∥. Four weighting parameters, multiplying theavailable four of the WF muxed files, i.e. Ou, Ov, Ox, Oy and Oz, in∥O∥, for obtaining the emphasized one of the data sets Sve, Sxe, Sye andSze, such as the data set Sve with an image of a horse, may have anidentical absolute value less than another identical absolute value offour weighting parameters, multiplying the available four of the WFmuxed files, i.e. Ou, Ov, Ox, Oy and Oz, in ∥O∥, for obtaining anotherone of the data sets Sve, Sxe, Sye and Sze, such as the data set Sxe,Sye or Sze, by a scalar or contracting factor such as less than onesecond, one fifth, one tenth or even one hundredth. The contractingfactor may be equal to a reciprocal of the emphasizing factor. Forexample, “intensities” of individual pixels, in the lattice of the41^(th) row and 51^(th) column, of the 4 reconstituted images in Sve,Sxe, Sye and Sze in ∥S∥ are 4 respective linear combinations, each ofwhich is a linear combination of intensities of individual pixels, inthe lattice of the 41^(th) row and 51^(th) column, of the available fourof the WF muxed files, i.e. any 4 of Ou, Ov, Ox, Oy and Oz, in ∥O∥,multiplied by four respective weighting parameters in ∥WDmx∥.

FIG. 5C illustrates another example of WF muxing/demuxing aspre-processing and post processing for a data storage application oncloud, presenting image storage/retrievals via 4-to-5 wavefront muxingon distributed cloud storages. The WF muxing/demuxing are vianon-orthogonal matrices. It depicts the original inputs in the first rowof FIG. 5C, stored images in wavefront muxed formats in the second rowof FIG. 5C, and reconstituted and recovered images in the third row ofFIG. 5C. The four pictures on the top row are four input images; 3photos token recently at Bronx Zoo in city of New York, and the 4^(th)one is an image of a classic painting, “a running horse”, by a famousChinese painter Mr. Xu Beihong in 1930's. The first, the second and thethird photos depict, respectively, a picture of an “Eagle” indicated asA1.png, a picture of a “Tiger” indicated as A2.png, and a picture of a“white head animal” indicated as A3.png. The “horse” is depicted asA4.png. They are all in PNG formats. Their pixel sizes in a rectangularlattice format are summarized in Table 2, ranging from 1024 to 1280 inone dimension and 683 to 1006 in the other dimension. The data sets A1,A2, A3, and A4 may be fully equalized in pixel dimensions into 4respective data sets A1 e, A2 e, A3 e, and A4 e in a lattice format of1280*1006 for pixels with respective intensities, wherein the equalizedimages A1 e-A4 e may have the number of rows, equal to or greater thanthe largest number of rows among the original images A1-A4, and thenumber of column, equal to the largest number of columns among theoriginal images A1-A4. The equalized images A5 e is a special matrix ofpixels with the same dimensions of 1280*1006, but each of the pixels inthe equalized image A5 e has an intensity value of “0”.

TABLE 2 original image dimensions and memory Original PNG files A1.pngA2.png A3.png A4.png Dimensions 1024 × 1006 1024 × 683  1024 × 768  1280× 890 Size 1.06 MB 1.19 MB 1.51 MB 1.20 MB Muxed PNG files Ou.png Ov.pngOx.png Oy.png Dimensions 1280 × 1006 1280 × 1006 1280 × 1006  1280 ×1006 Size 4.18 MB 3.41 MB 3.22 MB 4.14 MB Recovered PNG files Sv.pngSx.png Sy.png Sz.png Dimensions 1024 × 1006 1024 × 683  1024 × 768  1280× 890 Size 1.06 MB 1.19 MB 1.51 MB 1.20 MB

The WF muxing/demuxing transformations on pixel levels arepixel-by-pixel operations. One formulation for the concurrent pixellevel operations on these 5 images including the 4 pictures is to selecta pixel, e.g. in the 110^(th) column and the 23^(rd) raw, from a latticeposition, (xi, yj), of the five pixel matrices of the four equalizedimages, i.e. A1 e, A2 e, A3 e, A4 e, and A5 e. The intensities of theselected 5 input pixels are represented as ∥A′∥.

A “writing” processing features two steps: the first step is apixel-by-pixel operation converting intensities of pixels on a specifiedlattice (xi, yj) location of the five equalized pictures, i.e. A1 e, A2e, A3 e, A4 e and A5 e into 5 aggregated intensities of 5 wavefrontmultiplexed (WF muxed) pixels and then place the 5 aggregatedintensities of 5 WF muxed pixels at the specified lattice location (xi,yj) in the five respective MF muxed files Ou, Ov, Ox, Oy and Oz in ∥O∥,via the following wavefront multiplexing transformation.

$\begin{matrix}{{O} = {{{WMux}}\mspace{14mu} {A^{\prime}}}} & \left( {12\text{-}1} \right) \\{{{where}:\mspace{14mu} {O}} = \begin{bmatrix}{O\; u} \\{Ov} \\{Ox} \\{Oy} \\{Oz}\end{bmatrix}} & \left( {12\text{-}1a} \right) \\{{{{WMux}\; 1}} = \begin{bmatrix}3 & 1 & 1 & 1 & 3 \\1 & {- 1} & 1 & {- 1} & 0 \\1 & 1 & {- 1} & {- 1} & 0 \\1 & {- 1} & 1 & 3 & 2 \\3 & 3 & {- 1} & 3 & 4\end{bmatrix}} & \left( {12\text{-}1b} \right)\end{matrix}$

Referring to FIG. 5C, “intensities” of individual pixels, in the latticeof the same row and column, of the 5 WF muxed files, i.e. Ou, Ov, Ox, Oyand Oz, are 5 respective linear combinations, each of which is a linearcombination of intensities of individual pixels, in the lattice of thesame row and column, of the 5 equalized files, i.e. A1 e, A2 e, A3 e, A4e and A5 e, in ∥A′∥ multiplied by five respective weighting parametersin ∥WMux1∥. Five weighting parameters for multiplying one of the datasets A1 e-A5 e, such as the data set A1 e with an image of an eagle, mayhave an identical absolute value greater than another identical absolutevalue of five other weighting parameters for multiplying another one ofthe data sets A1 e-A5 e, such as the data set A2 e, A3 e or A4 e, by ascalar or emphasizing factor such as greater than two, five, ten or evenone hundred. For example, “intensities” of individual pixels, in thelattice of the 41^(th) row and 51^(th) column, of the 5 WF muxed files,i.e. Ou. Ov, Ox, Oy and Oz, are 5 respective linear combinations, eachof which is a linear combination of intensities of individual pixels, inthe lattice of the 41^(th) row and 51^(th) column, of the 5 equalizedfiles, i.e. A1 e, A2 e, A3 e, A4 e and A5 e, in ∥A′∥, multiplied by fiverespective weighting parameters in ∥WMux∥. Any 4 from the 5 equations,i.e. Ou. Ov, Ox, Oy and Oz, are independent. The selected 5*5 matrix,i.e. ∥WMux∥, features a minimum matrix rank of 4.

Referring to FIG. 5C, the second step involves transporting the 5 WFmuxed files, i.e. Ou. Ov, Ox, Oy and Oz, individually to 5 respectivelocal folders, at a transmitting site, which shall be synchronizedautomatically in series with 5 respective data storage or mirror sitesin IP cloud via Internet, wherein the 5 data storage or mirror sites maybe provided by different cloud storage providers respectively.Furthermore, multiple links linking to the five data sets stored in thefive respective data storage or mirror sites may be passed to therespective storage or mirror sites and/or stored in the transmittingsite. Some of the WF muxed data sets, i.e. Ou. Ov, Ox, Oy and Oz, may bestored locally at the transmitting site. The 5 pictures on the secondraw are the corresponding images of the 5 WF muxed files, i.e. Ou. Ov,Ox, Oy and Oz in ∥O∥, displayed through a conventional png imagedisplay. Referring to FIG. 5C, it appears that these images exhibitfeatures of camouflaged effects on the WF muxed data for storage; theoriginal images have been “weighted” differently, and in this case theimage of “Eagle” is emphasized. As a result, the “Eagle” image taken atBronx Zoo appears on all 5 WF muxed data sets Ou. Ov, Ox, Oy and Oz inthe second row with appearances of various intensity or brightnesssettings. There are no traces of other three images at all.

The third row in FIG. 5C depicts 4 restructured images from any 4 of the5 WF muxed data sets Ou. Ov, Ox, Oy and Oz via a reading process. A“reading” processing also features two steps. The first step involvesretrieving any 4 of the 5 WF muxed files, i.e. Ou, Ov, Ox, Oy and Oz,derived from 5 separated local folders, i.e. memory sets in a localmemory device at a receiving site, synchronized automatically in serieswith the 5 respective storage or mirror sites in IP Cloud storage viaInternet optionally in accordance with the links passed from therespective storage or mirror sites or transmitting site to the receivingsite. The second step involves converting any four or all of the WFmuxed files, i.e. Ou, Ov, Ox, Oy and Oz, in ∥O∥ into four recovered orreconstituted equalized image files Sve, Sxe, Sye and Sze in ∥S∥ via awavefront demultiplexing transformation. The recovered or reconstitutedequalized image files Sve, Sxe, Sye and Sze may be substantiallyequivalent to the four equalized pictures A1 e-Ae4 respectively if theWF muxed files, i.e. Ou, Ov, Ox, Oy and Oz, are not contaminated.Assuming the available four files are Ov, Ox, Oy and Oz represented by∥O1∥, the WF demuxing transformation (WF demuxing) shall become:

$\begin{matrix}{{S} = {{{{WDmx}\; 1}}\mspace{14mu} {{O\; 1}}}} & \left( {12\text{-}2} \right) \\{{{where}:\mspace{14mu} {S}} = \begin{bmatrix}{Sve} \\{Sxe} \\{Sye} \\{Sze}\end{bmatrix}} & \left( {12\text{-}2a} \right) \\{{{{WDmx}\; 1}} = \begin{bmatrix}{1/4} & {1/2} & {1/4} & 0 \\{1/4} & {- 1} & {{- 3}/4} & {1/2} \\{3/4} & {{- 3}/2} & {{- 3}/4} & {{- 1}/2} \\{{- 1}/4} & 0 & {1/4} & 0\end{bmatrix}} & \left( {12\text{-}2b} \right) \\{{{O\; 1}} = \begin{bmatrix}{Ov} \\{Ox} \\{Oy} \\{Oz}\end{bmatrix}} & \left( {12\text{-}2c} \right) \\{{Furthermore},{{{{{WDmx}\; 1}}\mspace{14mu} {{{WMux}\; 1}}} = {I}}} & \left( {12\text{-}3} \right)\end{matrix}$

∥WMux1∥ is a subset of ∥WMux∥, where:

$\begin{matrix}{{{{WMux}\; 1}} = \begin{bmatrix}1 & {- 1} & 1 & {- 1} \\1 & 1 & {- 1} & {- 1} \\1 & {- 1} & 1 & 3 \\3 & 3 & {- 1} & 3\end{bmatrix}} & \left( {12\text{-}3a} \right)\end{matrix}$

Referring to FIG. 5C, “intensities” of individual pixels, in the latticeof the same row and column, of the 4 recovered or reconstitutedequalized images, i.e. Sve, Sxe, Sye and Sze, in ∥S∥, are 4 respectivelinear combinations, each of which is a linear combination ofintensities of individual pixels, in the lattice of the same row andcolumn, of the available four WF muxed files, i.e. Ov, Ox, Oy and Oz, in∥O1∥, multiplied by four respective weighting parameters in ∥WDmx1∥.Four weighting parameters, multiplying the available four WF muxedfiles, i.e. Ov, Ox, Oy and Oz, in ∥O1∥, for obtaining the emphasized oneof the data sets Sve, Sxe, Sye and Sze, such as the data set Sve with animage of an eagle, may have an identical absolute value less thananother identical absolute value of four weighting parameters,multiplying the available four WF muxed files, i.e. Ov, Ox, Oy and Oz,in ∥O1∥, for obtaining another one of the data sets Sve, Sxe, Sye andSze, such as the data set Sxe, Sye or Sze, by a scalar or contractingfactor such as less than one second, one fifth, one tenth or even onehundredth. The contracting factor may be equal to a reciprocal of theemphasizing factor. The four recovered or reconstituted equalized imagefiles Sve, Sxe, Sye and Sze may then be converted via a de-equalizingprocess into four recovered or reconstituted image files Sv, Sx, Sy andSz substantially equivalent to the four original pictures A1-A4respectively. For example, “intensities” of individual pixels, in thelattice of the 41^(th) row and 51^(th) column, of the 5 reconstitutedimages in Sve, Sxe, Sye and Sze in ∥S˜ are 4 respective linearcombinations, each of which is a linear combination of intensities ofindividual pixels, in the lattice of the 41^(th) row and 51^(th) column,of the available four WF muxed files, i.e. Ov, Ox, Oy and Oz, in∥O1∥∥O∥, multiplied by four respective weighting parameters in ∥WDmx1˜.

It is clear that the four restructured images Sv, Sx, Sy and Sz in ∥S˜are identical to the 4 original pictures A1, A2, A3 and A4 in ∥A∥. As tocreating data under Camouflaged appearance on cloud storage via WFmuxing processing, we present another example depicted in FIG. 5D.Original 4 images, i.e. A1, A2, A3 and A4, are identical to those inFIG. 5C. However, they are WF muxed by a different transformation (a4-to-4 matrix), and there are no reserved redundancies on cloud. The 4recovered image outputs, i.e. Sv, Sx, Sy and Sz, in the third row inFIG. 5D are also identical to the original 4 images, i.e. A1, A2, A3 andA4, respectively.

The differences between FIG. 5C and FIG. 5D are the images in the secondrow in these Figs; the WF muxed images to be stored on cloud. Theyappear very different; 5 WF muxed files Ou, Ov, Ox, Oy and Oz are in thesecond row in FIGS. 5C and 4 muxed files Ov, Ox, Oy and Oz are in thesecond row in FIG. 5D. To create various camouflaged effects on the WFmuxed data for storage; the original images have been “weighted”differently for the “horse” painting, i.e. A4 e, in FIG. 5D. As aresult, the image of “horse” painted by Xu Baihong appears on all 4 WFmuxed data, i.e. Ov, Ox, Oy and Oz, with appearances of variousintensity settings.

It is clear that the sizes of the original data sets A1-A4 are identicalto those of the recovered or reconstituted data sets Sv, Sx, Sy and Sz.The WF muxed data sets Ov, Ox, Oy and Oz each feature a size about 2 to3 times larger than those of the original images A1-A4 or recoveredimages Sv, Sx, Sy and Sz. It is because (1) more pixels are added toequalize all 4 images A1-A4 into 4 equalized ones A1 e-A4 e featuringidentical pixel dimensions, and (2) double precision operations areimplemented for WF muxing/demuxing transformations to avoid overflow andunderflow.

In another scenario when a first reader has a digital data file, i.e.Sze, of the “horse” painted by Mr. Xu (i.e. the Sz image), the firstreader only needs to access 3 of the 4 data files on cloud to recoverthe remaining three images, i.e. Sve, Sxe and Sye. It is important tonotice that every redundancy in wavefront multiplexing is for all threeimages as far as the first reader is concerned. On the other hand, asecond reader who does not have the digital “horse” initially mustdownload all four data files on cloud in order to recover any or all ofthe 4 images.

For a third scenario in a different application for a data integritymonitoring service, the “horse” may be used as a known diagnostic image,i.e. A4 e. The stored data features integrity that may be monitored bycomparing the recovered diagnostic image data, i.e. Sze, to the knowndiagnostic image, i.e. A4 e, of “horse” or by comparing the recovereddiagnostic image data, i.e. Sz, to the known diagnostic image, i.e. A4,of “horse”, without accessing the rest of recovered equalized images ofSve, Sxe, and Sye or recovered images of Sv, Sx, and Sy at all. If anyone of the 4 data sets Ov, Ox, Oy and Oz stored in the memory or memorysites in the IP cloud is compromised or altered, there could bedifferences between the equalized image data set A4 e, i.e. “house”painting, and the recovered or reconstituted equalized image set Sze,i.e. “house” painting, by comparing the data sets A4 e and Sze or therecould be differences between the image data set A4, i.e. “house”painting, and the recovered or reconstituted image set Sz, i.e. “house”painting, by comparing the data sets A4 and Sz. Thereby, one coulddetect alternations in any of the 4 WF muxed data files Ov, Ox, Oy andOz stored in the IP cloud. The compromised data may have been altered byintruders, or changed by defensive mechanisms triggered by intruders.Once the stored data sets, i.e. WF muxed data set Ov, Ox, Oy and Oz, aredetermined to be compromised, the 4 stored data sets Ov, Ox, Oy and Ozare labeled accordingly, and the owners of the data sets will benotified accordingly. The operators of data storages do not have accessto any of the data sets A1, A1 e, A2, A2 e, A3, A3 e, Sv, Sve, Sx, Sxe,Sy and Sye. They only use the diagnostic data files Sze or Sz and A4 orA4 e, i.e. the horse image in this example to monitor the integrity ofthe stored data sets Ov, Ox, Oy and Oz on the IP cloud, which confirmsthe integrity of recovered data sets Sv, Sx and Sy

In addition, a fourth application will be “data integrity monitoring andauto-recovery service.” Since the “house” painting data set Sz or Sze isknown a priori, substantially equivalent to the data set A4 or A4 e,there are only three unknown data sets, i.e. Sve, Sxe and Sye, but with4 different linear combinations, i.e. Qv, Ox, Oy and Oz, for these threedata sets Sve, Sxe and Sye. There are sufficient independent linearcombinations to identify which one of the 4 stored data sets, i.e. Qv,Ox, Oy and Oz, has been compromised. The compromised data subset may berestored using the other 3 stored and uncompromised data sets and theknown diagnostic file Sze, i.e. the horse painting in this example.

FIG. 5E illustrates an example of image data storage and transport viawavefront muxing by a non-orthogonal matrix without redundancy, andretrieval via a corresponding wavefront demuxing matrix. Themuxing/demuxing transformations are performed pixel-by-pixel asmentioned above. The first row in FIG. 5E features 6 input image filesA1-A6, including the “horse” painting, the second row in FIG. 5E are theresults Ou, Ov, Ow, Ox, Oy and Oz, WF muxed pixel by pixel via sixlinear combinations of 6 equalized image files derived from the inputimage files A1-A6 respectively, and the third row in FIG. 5E depicts the6 retrieved images via a corresponding WF demuxing transformation andde-equalizing process from the 6 stored data sets, i.e. Ou, Ov, Ow, Ox,Oy and Oz. It is noticed that the 6 pictures Ou, Ov, Ow, Ox, Oy and Ozin the second row appear as images of the “horse” painting withdifferent brightness settings.

Examining by eyes the pictures Ov, Ox, Oy and Oz in the second row ofFIG. 5A, the pictures Ou, Ov, Ox, Oy and Oz in the second row of FIG.5B, and the pictures Ou, Ov, Ox, Oy and Oz in the second row of FIG. 5E,they all appear as images of the painting of “a running horse”;independent from (1) numbers of inputs/outputs (I/O's) on WFmuxing/demuxing transformations, (2) which specific WF muxingtransformation may be utilized, (3) whether the WF muxingtransformations are with or without redundancy features, (4) how theredundancies of the WF muxing transformations are generated, and (5) allother accompanied images sharing the same data storage or mirror sites.As a result, it becomes very difficult to “invert” the functionaltransformation processes to reconstitute “desired” data sets (equalizedimage files), which may be de-equalized into the image data sets, i.e.Sx, Sy and Sz, as shown in the third row of FIGS. 5A and 5B, which areimbedded in the set of stored or transported images of “a running horse”as shown in the second row of FIGS. 5A and 5B.

It might be possible that some of these WF muxed images of “a run house”in FIGS. 5A, 5B, 5D, or 5E might be no more than the input data set,i.e. real images of the famous painting of “a running horse”. These WFmuxed images may belong to a steganography, which is a “cousin” ofcryptography, used with codes. While cryptography provides privacy,steganography provides secrecy. Privacy is what you need when you useyour credit card on the Internet—you don't want your number revealed tothe public. For this, you use cryptography, and send a coded pile ofgibberish that only the web site can decipher. Though your code may beunbreakable, any hacker can look and see a message you've sent. For truesecrecy, you don't want anyone to know you're sending a message at all.

Embodiment 3

The techniques of video streaming via multiple mirroring sites viawavefront multiplexing depicted in FIGS. 6A, 6B, 6C and 6D consist ofthree segments; (1) a pre-storage processing 610, (2) Mirroring site inIP network 630, and (3) data streaming processing 620. The multiplemirror sites 631 feature nearly equal data storage space. An example ofstreaming a video with a 100-minute play time in real time is utilizedin here to illustrate the operation concepts. Elements in FIGS. 6A, 6B,6C and 6D having the same reference number as those in FIGS. 1, 1A, 2A,2B, 3 and 3A may refer to those illustrated in FIGS. 1, 1A, 2A, 2B, 3and 3A.

FIG. 6A depicts a data preprocessing and storage portions of anoperation concept of using WF multiplexing 101 techniques for videostreaming via multiple mirroring sites. FIG. 6B is a top-levelfunctional diagram for storing the WF muxed video substreams. Referringto FIGS. 6A and 6B, the video stream 105 with a 100-minute playing timemay be “segmented” by a segment processor 102 into 6000 video blocks intime, i.e. each video block having playing time of a second. One blockof video shall have about 1 Megabytes (MB) or less of data. In a timeframe of 5 seconds, the segment processor 102 takes 5 video blocksarranged in series in the data stream U1, i.e. 105, at a time andconverts them into 5 parallel blocks 104, i.e. S1, S2, S3, S4 and S5.The segment processor 102 may take 1200 time frames, each of which mayinclude 5 sequential video blocks to be input into the WF muxer 104, andconvert the 6000 video blocks in the 1200 time frames into 5 videosubstreams S1, S2, S3, S4 and S5, each of which carries 1200 videoblocks output from the segment processor 102.

Referring to FIGS. 6A and 6B, in each time frame, the outputs S1, S2,S3, S4 and S5 of the segment processor 602 are connected to the first 5,i.e. slice1-slice5, of the 8 input slices of the 8-to-8 WF muxer 101.The 8 parallel outputs 106 of the WF muxers 101 are the structured datato be stored in 8 separated local folders, i.e. memory sets in a localmemory device 632, synchronized automatically in series with 8respective mirror sites or data storage sites 131-1 through 131-8 in theIP cloud 130, which may be provided by different cloud storage providersrespectively via Internet for video streaming later. Furthermore,multiple links linking to the eight data sets stored in the eightrespective data storage or mirror sites 131-1 through 131-8 may bepassed to one or more of the data storage or mirror sites 131-1 through131-8 and/or stored in the transmitting site. Some of the data setsD1-D8 may be stored locally at the transmitting site.

The 6000 input blocks 51-55 of a video stream are converted into 8 WFmuxed substreams 106, i.e. D1-D8. The segment processor 102 takes 1200time frames 105, arranged in series, and converts the 6000 sequentialvideo blocks U1 into 5 parallel video substreams 104, i.e. S1-S5, eachof which contains 1200 output blocks. The 5 video substreams 104, i.e.S1-S5, are converted by the 8-to-8 WF muxer 101, one frame at a time,into 8 WF muxed video substreams 106, i.e. D1-D8, each of which contains1200 WF muxed blocks in different time frames. Each of the WF muxedblocks D1-D8 may be a linear combination of the video blocks 104, i.e.S1-S5 in the same time frame, and diagnostic or “zero” blocks 108, eachweighted by a corresponding weighting parameter. Each of the WF muxedblocks D1-D8 contains information associated with all of the parallelvideo blocks 104, i.e. S1-S5 in the same time frame, and diagnostic or“zero” blocks 108. Each of the diagnostic or “zero” blocks 108 may becoupled to a reference ground or carries a “zero” value, or may beassigned to a redundant data set. These WF muxed substreams are storedin 8 physically separated local folders, i.e. memory sets at atransmitting site, synchronized automatically in series with 8respective mirror sites or data storage sites 131-1 through 131-8 in theIP cloud 130 via Internet optionally in accordance with the links passedfrom one or more of the storage or mirror sites 131-1 through 131-8 ortransmitting site to the receiving site.

FIG. 6C shows the retrieval processing of the 5 sets of video substreamsfrom user terminals. FIG. 6D is a top-level functional diagram forretrieving multiple WF muxed video substreams and converting them intothe desired video stream.

Pre-Storage Processing:

Referring to FIG. 6A and 6B, in the pre-storage processing 110 a 8-to-8WF muxer 101 is used to convert 5 sets of video substreams or videoblocks 104, i.e. S1, S2, S3, S4 and S5 in the same time frame, into 8outputs of WF muxed video substreams, i.e. D1,D2, D3, D4, D5, D6, D7 D8,where

D1=S1+S2+S3+S4+S5  (13-1)

D2=S1−S2+S3−S4+S5  (13-2)

D3=S1+S2−S3−S4+S5  (13-3)

D4=S1−S2−S3+S4+S5  (13-4)

D5=S1+S2+S3+S4−S5  (13-5)

D6=S1−S2+S3−S4S5  (13-6)

D7=S1+S2−S3−S4−S5  (13-7)

D8=S1−S2−S3+S4−S5  (13-8)

A 8-to-8 Hadamard matrix in which all elements are “1” or “−1” only hasbeen chosen as the 8-to-8 WF muxer. Equations (13-1) to (13-8) can bewritten in a matrix form as:

D=HM*S  (14)

where: D=[D1,D2,D3,D4,D5,D6,D7,D8]^(T)  (14-1)

S=[S1,S2,S3,S4,S5,0,0,0]^(T),  (14-2)

-   -   and the 8-to-8 Hadamard matrix HM is expressed in equation        (2-2).

The input ports of a WF muxer 101 are referred to as slices, and itsoutput ports are wavefront components (wfc's). In this example, the fiveinput data sets 104, i.e. S1, S2, S3, S4 and S5, are connected to theinput ports, i.e. slice1, slice2, slice3, slice4 and slice5, of the WFmuxer 101 respectively. The 8 output data sets 106, i.e. D1-D8, areconnected to the output ports, i.e. wfc1-wfc8, of the WF muxer 101respectively.

When the WF muxer is connected by a unity input data set only, e.g. S4=

through the input port of Slice 4, the corresponding outputs of the WFmuxer are written as:

D1=S1+S2+S3+S4+S5=[1]  (15-1)

D2=S1−S2+S3−S4+S5=[−1]  (15-2)

D3=S1+S2−S3−S4+S5=[−1]  (15-3)

D4=S1−S2−S3+S4+S5=[1]  (15-4)

D5=S1+S2+S3+S4S5=[1]  (15-5)

D6=S1−S2+S3−S4S5=[−1]  (15-6)

D7=S1+S2−S3−S4S5=[−1]  (15-7)

D8=S1−S2−S3+S4−S5=[1]  (15-8)

The 8 output data sets can be represented as an output data matrix, D.The elements of the output matrix D become identical to the 8 elementsof the 4th column in the HM, under the condition. In this case, thewavefront vector of the output data sets representing the matrix D isreferred to as the 4th wavefront vector (WFV), or WFV4. Similarly, thewavefront vector associated with the k^(th) input port, slice k, isreferred to as k^(th) WFV or WFVk. A WF vector specifies thedistribution of a set of input data among the 8 output ports wfc1-wfc8or among 8 aggregated output data sets, i.e. D1, D2, D3, D4, D5, D6, D7and D8.

In general, an 8-to-8 WF muxer, such as the WF muxer 101, features 8orthogonal WFVs. A coefficient wjk of a WF transformation performed bythe WF muxer 101 means the coefficient is at the j^(th) row and k^(th)column of the WF muxer 101. A WF vector of the WF muxer 101 featuring adistribution among the 8 outputs, i.e. D1-D8 at the 8 WF component portswfc1-wfc8, is defined as an 8-dimensional (8-D) vector. They aremutually orthogonal.

The first 5 WFVs of the WF muxer 101 are:

WFV1=[w11,w21,w31,w41,w51,w61,w71,w81]^(T)  (16.1)

WFV2=[w12,w22,w32,w42,w52,w62,w72,w82]^(T)  (16.2)

WFV3=[w13,w23,w33,w43,w53,w63,w73,w83]^(T)  (16.3)

WFV4=[w14,w24,w34,w44,w54,w64,w74,w84]^(T)  (16.4)

WFV5=[w15,w25,w35,w45,w55,w65,w75,w85]^(T)  (16.5)

The input data sets 104, i.e. S1, S2, S3, S4 and S5, are coupled to thefirst five input ports, i.e. slice1-slice5, of the WF muxer 101 so as tobe “attached” to 5 WF vectors, i.e. WFV1-WFV5. There are 3 remainingWFVs: WFV6, WFV7, and WFV8, which are utilized for inputs with “zerosignals” of the diagnostic blocks 108 in this case. All components ofthe 8 orthogonal WFVs are independent of input data sets 104 and outputdata sets 106, but are related to the sequence of the input ports, i.e.slice1-slice8, and the output ports, i.e. wfc1-wfc8.

The 8 outputs 106, i.e. D1-D8, at the 8 ports, i.e. wfc1-wfc8, of the WFmuxer 101 feature 8 respective linear combinations of the 5 input videosubstreams 104, i.e. S1-S5, and 3 diagnostic streams 108 carrying “zero”values, or 8 aggregated or WF muxed video substreams. Each of the WFmuxed video substreams D1-D8 is a weighted sum of the 5 input videosubstreams 104, i.e. S1-S5, as well as 3 “zero” signals streams 108, andthe WF muxed video substreams D1-D8 are independent. As a result, eachof the 8 aggregated or WF muxed video substreams D1-D8 features a resultof structured arithmetic operations (weighting, or multiplying, andsumming) on the 5 independent data sets S1-S5. The 8 aggregated or WFmuxed video substreams D1-D8 appear as 8 respective data streams withrandom numbers.

Most commercial software tools run the arithmetic operations withlimitations on word lengths of integers. The operations of addition andsubtraction in the WF muxing transformation can go beyond the maximumword length of 8 bytes. Each video block of the video substreams 104,i.e. S1-S5, may have a size of about 1 MB that may be divided into about143,000 words with 7-byte length. To perform arithmetic addition andsubtraction on 8 blocks of the video substreams 104, i.e. S1-S5 in thesame time frame, and diagnostic substreams 108, the first 7-byte wordfrom the video stream data of S1 may be added to the first 7-byte wordfrom the video stream data of S2. The sum is saved in the block D1 asthe first word, which will be with a format of 8-byte word to assure ofno overflow or underflow issues. There is a 8/7 ratio of the memory sizeof the WF muxed video substream D1, D2, D3, D4, D5, D6, D7 or D8 to thatof segmented video substream S1, S2, S3 S4 or S5; more than 15% ofadditional memory size is required for the WF muxed video substream 106,i.e. D1, D2, D3, D4, D5, D6, D7 or D8, compared to the segmented videosubstream 104, i.e. S1, S2, S3 S4 or S5.

Alternatively, each video block of the video substreams 104, i.e. S1-S5,may have a size of about 1 MB that may be divided into about 143,000words with 7-byte length. To perform arithmetic addition and subtractionon 8 blocks of the video substreams 104, i.e. S1-S5, and diagnosticsubstreams 108, first 7-byte words of the video data sets 104, i.e.S1-S5 in the same time frame, and the diagnostic data sets 108 may beweighted by respective weighting parameters and then may be addedtogether into a sum represented as either one of the WF muxed blocksD1-D8, each of which may be in a format of 8-byte word to assure nooverflow or underflow issues. There is a 8/7 ratio of the memory size ofthe WF muxed video substream D1, D2, D3, D4, D5, D6, D7 or D8 to that ofsegmented video substream S1, S2, S3 S4 or S5; more than 15% ofadditional memory size is required for the WF muxed video substream 106,i.e. D1, D2, D3, D4, D5, D6, D7 or D8, compared to the segmented videosubstream 104, i.e. S1, S2, S3 S4 or S5.

One may conceivably construct software routines or digital calculatorsto perform arithmetic operations of addition/subtraction word by wordamong video blocks S1-55, each of which has about 10101 words with99-byte word-length in each time frame, so as to generate a result in aformat with a word length of 100 bytes. In this case, the additionalmemory size for each of the 8-to-8 WF muxed video substreams 106, i.e.D1-D8, is about 1% more than that of either of the segmented videosubstreams 104, i.e. S1-55. The muxing processor 103, such as time,frequency or code domain multiplexer, allows the 8 pre-processed datasets, i.e. the output data sets D1-D8 from the WF muxer 101 in parallel,to be muxed based on time, frequency or code and then delivered inseries through a single pipe, or communication output port 107 tovarious data mirror sites 131-1 through 131-8 in IP Cloud 130 viaInternet.

Mirroring Sites in IP Network 130:

As shown in FIGS. 6A and 6B, the five independent video substream datasets 104, i.e. S1, S2, S3, S4 and S5, and three diagnostic or “zero”data sets 108 are muxed by the WF muxer 101 into 8 data sets D1-D8 to bestored in 8 local folders, i.e. memory sets, synchronized automaticallyin series with 8 respective data storage sites or data mirror sites,i.e. 131-1 through 131-8, in IP cloud 130, which may be provided bydifferent cloud storage providers respectively, via Internet. The 8 datasets D1-D8 may be 8 different linear combinations of the five videosubstream data sets 104, i.e. S1-55, and the three diagnostic or “zero”data sets 108. Each of the mirror sites 131-1 through 131-8 only storesan assigned one of the 8 MF muxed video substream data sets 106, i.e.D1-D8. The data storage sites 131-1 through 131-8 may store the datasets 106, i.e. D1-D8, respectively.

Post Retrieval Processing 120:

FIGS. 6C and 6D depicts the demuxing processor 113, such as time,frequency or code domain demultiplexer, that may recover parallel datasets 116, i.e. D′1-D′8, based on time, frequency or code from the datasets, stored in 8 separated local folders, i.e. memory sets in a localmemory device at a receiving site, synchronized automatically in serieswith 8 storage or mirror sites 131-1, 131-2, 131-3, 131-4, 131-5, 131-6,131-7 and 131-8 in IP Cloud storage 130 via Internet so as to enableusers to use the WF demuxing transformation 111 to retrieve data setsS′1-S′5, substantially equivalent to the input data sets S1-S5respectively if the stored data sets are not contaminated. The data sets116, i.e. D′1-D′8, may be substantially equivalent to the data sets 106,i.e. D1-D8, respectively.

FIG. 6C depicts an operation concept of reconstructing the desired videostreams S′1-S′5 from only 5 of the 8 WF muxed data sets stored in themirror sites 131-1 through 131-8. As indicated in this example, thefirst 5 WF muxed data sets arriving the WF demuxer 111 are D′2, D′3,D′4, D′S, and D′8. The last three WF muxed sets arriving the WF demuxer111 are D′1, D′6 and D′7 that may be omitted to be demuxed by the WFmuxer 111. Only the first 5 of the 8 WF muxed video substream data setsarriving the WF demuxer 111 are used for retrieving or recovering thevideo data sets S′1-S′5 that may be combined into the desired videostream 115, i.e. U′1. the first 5 WF muxed video data sets, i.e. D′2,D′3, D′4, D′S and D′8, arriving the WF demuxer 111 are illustratedwhere:

D′2=S′1−S′2+S′3−S′4+S′5  (17-1)

D′3=S′1+S′2−S′3−S′4−+S′5  (17-2)

D′4=S′1−S′2−S′3+S′4+S′5  (17-3)

D′5=S′1+S′2+S′3+S′4−S′5  (17-4)

D′8=S′1−S′2−S′3+S′4−S′5  (17-5)

Therefore, the recovered data sets, i.e. S′1, S′2, S′3, S′4, and S′5 canthen be solved one time frame by one time frame by the modifiedwavefront demuxer 111 where:

S′1=(D′2+D′3+D′5+D′8)/4  (17-6)

S′5=(D′4−D′8)/2  (17-7)

S′3=(D′2+D′5)/2−S′1  (17-8)

S′2=(D′5−D′8)/2−S′3  (17-9)

S′4=(D′3−D′4)/2+S′2  (17-10)

The data sets 116, i.e. D′1-D′8, may be substantially equivalent to theoutput data sets, i.e. D1-D8, respectively if not contaminated. Thereby,the recovered data sets 114, i.e. S′1-S′5, if not contaminated, may besubstantially equivalent to the data sets, i.e. S1-S5, respectively.There are many different combinations of taking 5 WF muxed sets 117 from8 ones stored in the respective data mirroring sites 131-1 through131-8. In this case, there are 56 possible combinations to be present.The WF demuxer 111 shall be designed to handle the all possiblecombinations. There are many different but equivalent methods/approachesof solving 5 simultaneous equations for 5 unknowns. Each of theretrieved data sets or video blocks 114, i.e. S′1-S′5 in the same timeframe, may be a linear combination of the data sets 116, i.e. D′2, D′3,D′4, D′5 and D′8 in the same time frame, each weighted by acorresponding weighting parameter. Each of the retrieved data sets 114,i.e. S′1-S′S, in the same time frame contains information associatedwith the data sets 116, i.e. D′2, D′3, D′4, D′S and D′8, in the sametime frame.

The recovered 5 parallel video substream blocks 114, i.e. S′1-S′S in thesame time frame, may be combined into a large data set U′1, i.e. 115,including 5 sequential video blocks, i.e. S′1-S′5, via thede-segmentation processor 112.

Embodiment 4

Another set of techniques of video streaming via multiple mirroringsites via wavefront multiplexing depicted in FIGS. 7A and 7B consist ofthree segments; (1) a pre-storage processing 110, (2) cloud storage 130,and (3) data streaming processing 120. The multiple mirror sites 131-1through 131-8 feature nearly equal data storage space. The onlydifference of the embodiment 4 from embodiment 3 is the introductions ofembedded digital data sets 109, i.e. Sx, as authentication/security keyor as probing signals, which may be muxed with the video blocks S1-S5one time frame by one time frame by a WF muxer 101. An example ofstreaming a video with a 100-minute play time in real time is utilizedin here to illustrate the operation concepts. Elements in FIGS. 7A and7B having the same reference number as those in FIGS. 1, 1A, 2A, 2B, 3,3A and 6A-6D may refer to those illustrated in FIGS. 1, 1A, 2A, 2B, 3,3A and 6A-6D.

FIG. 7A depicts a data preprocessing and storage portions using WFmultiplexing 101 techniques for video streaming via multiple mirroringsites. The video stream 105 with a 100-minute playing time is“segmented” by a segment processor 102 into 6000 video blocks in time,i.e. each video block having playing time of a second. One block ofvideo shall have about 1 Megabytes (MB) or less of data. In a time frameof 5 seconds, the segment processor 102 takes 5 video blocks arranged inseries in the data stream U1, i.e. 105, at a time and converts them into5 parallel blocks 104, i.e. S1, S2, S3, S4 and S5. The segment processor102 may take 1200 time frames, each of which may include 5 sequentialvideo blocks to be input into the WF muxer 104, and convert the 6000video blocks in the 1200 time frames into 5 video substreams S1, S2, S3,S4 and S5, each of which carries 1200 video blocks output from thesegment processor 102.

Referring to FIGS. 7A and 7B, in each time frame, the outputs S1, S2,S3, S4 and S5 of the segment processor 102 are connected to the first 5,i.e. slice1-slice5, of the 8 input slices of an 8-to-8 WF muxer 101. The6^(th) input, slice 6, is connected to a known and diagnostic datastream 109, i.e. Sx. The 8 parallel outputs 106, i.e. D1-D8, of the WFmuxers 101 are the structured data to be stored in 8 separated localfolders, i.e. memory sets in a local memory device 632 at a transmittingsite, synchronized automatically in series with 8 respective mirrorsites or data storage sites 131-1 through 131-8 in the IP cloud 130,which may be provided by different cloud storage providers respectively,via Internet for video streaming later. Furthermore, multiple linkslinking to the eight data sets stored in the eight respective datastorage or mirror sites 131-1 through 131-8 may be passed to one or moreof the data storage or mirror sites 131-1 through 131-8 and/or stored inthe transmitting site. Some of the data sets D1-D8 may be storedloccally at the transmitting site.

The 6000 input blocks S1-S5 of a video stream are converted into 8 WFmuxed substreams 106, i.e. D1-D8. The segment processor 102 takes 1200time frames 105, arranged in series, and converts the 6000 sequentialvideo blocks U1 into 5 parallel video substreams 104, i.e. S1-S5, eachof which contains 1200 output blocks. The 5 video substreams 104, i.e.S1-S5, plus the known data stream 109, i.e. Sx, for theauthentication/security keys or probing signals, and two additional“zero” signal streams 108 are converted one time frame by one time frameby the 8-to-8 WF muxer 101 into 8 WF muxed video substreams 106, i.e.D1-D8, each of which contains 1200 WF muxed blocks. Each of the WF muxedblocks D1-D8 may be a linear combination of the video blocks 104, i.e.S1-S5 in the same time frame, and diagnostic block 109, i.e. Sx, and two“zero” blocks 108, each weighted by a corresponding weighting parameter.Each of the WF muxed blocks D1-D8 contains information associated withall of the parallel video blocks 104, i.e. S1-S5 in the same time frame,diagnostic block 109, i.e. Sx, and “zero” blocks 108. Each of the “zero”blocks 108 may be coupled to a reference ground or carries a “zero”value, or may be assigned to a redundant data set. These WF muxedsubstreams are stored in 8 physically separated local folders, i.e.memory sets, synchronized automatically in series with 8 respectivemirror sites or data storage sites 131-1 through 131-8 in the IP cloud130 via Internet optionally in accordance with the links passed from oneor more of the storage or mirror sites 131-1 through 131-8 ortransmitting site to the receiving site.

FIG. 7B shows the retrieval processing of the 5 sets of video substreamsfrom user terminals.

Referring to FIG. 7A, in the pre-storage processing, n a 8-to-8 WF muxer101 is used to convert 5 sets of video substreams or video blocks 104,i.e. S1, S2, S3, S4 and S5 in the same time frame, into 8 outputs of WFmuxed video substreams, i.e. D1,D2, D3, D4, D5, D6, D7 and D8, where

D1=S1+S2+S3+S4+S5+Sx  (18-1)

D2=S1−S2+S3−S4+S5−Sx  (18-2)

D3=S1+S2−S3−S4+S5+Sx  (18-3)

D4=S1−S2−S3+S4+S5−Sx  (18-4)

D5=S1+S2+S3+S4−S5−Sx  (18-5)

D6=S1−S2+S3−S4−S5+Sx  (18-6)

D7=S1+S2−S3−S4−S5−Sx  (18-7)

D8=S1−S2−S3+S4−S5+Sx.  (18-8)

A 8-to-8 Hadamard matrix in which all elements are “1” or “−1” only hasbeen chosen as the 8-to-8 WF muxer. Equations (18-1) to (18-8) can bewritten in a matrix form as

D=HM*S  (18)

where: D=[D1,D2,D3,D4,D5,D6,D7,D8]^(T)  (18-9)

S=[S1,S2,S3,S4,S5,Sx,0,0]^(T),  (18-10)

-   -   and the 8-to-8 Hadamard matrix is expressed as in equation        (2-2).

The input ports of a WF muxer 101 are referred to as slices, and itsoutput ports are wavefront components (wfc's). In this example, the fiveinput data sets 104, i.e. S1-S5, are connected to the input ports, i.e.slice1, slice2, slice3, slice4 and slice5, of the WF muxer 101respectively. The diagnostic data set 109, i.e. Sx, is connected to theinput port slice6 of the WF muxer 101. The 8 output data sets 106, i.e.D1-D8, are connected to the output ports, i.e. wfc1-wfc8, of the WFmuxer 101 respectively.

A WF vector specifies the distribution of a set of input data among the8 output ports wfc1-wfc8 or among 8 aggregated output data sets, i.e.D1, D2, D3, D4, D5, D6, D7 and D8. In general, an 8-to-8 WF muxer, suchas the WF muxer 101, features 8 orthogonal WFVs. A coefficient wjk of aWF muxer 101 is the element of the j^(th) row and the k^(th) column ofthe WF muxer 101.

A WF vector of the WF muxer 101 featuring a distribution, as illustratedin equations 10.1-10.6, among the 8 outputs, i.e. D1-D8, at the 8 WFcomponent ports wfc1-wfc8, is defined as an 8-dimensional (8-D) vector.They are mutually orthogonal.

The input data sets 104, i.e. S1, S2, S3, S4 and S5, are coupled to thefirst five input ports, i.e. slice1-slice5, of the WF muxer 101 so as tobe “attached” to the first 5 WF vectors, i.e. WFV1-WFV5. The diagnosticdata set 109, i.e. Sx, may be coupled to the sixth input port, i.e.slice6, of the WF muxer 101 so as to be “attached” to the 6^(th) WFvector WFV6 where:

WFV6=[w16,w26,w36,w46,w56,w66,w76,w86]^(T)  (19)

There are 2 remaining WFVs; WFV7, and WFV8, which are utilized forinputs with “zero signals” of the diagnostic blocks 108 in this case.All components of the 8 orthogonal WFVs are independent of input datasets 104 and output data sets 106, but are related to the sequence ofthe input ports, i.e. slice1-slice8, and the output ports, i.e.wfc1-wfc8.

The 8 outputs 106, i.e. D1-D8, at the 8 ports, i.e. wfc1-wfc8, of the WFmuxer 101 feature 8 respective linear combinations of the 5 input videosubstreams 104, i.e. S1-S5, the diagnostic data or video stream 109,i.e. Sx, and 2 “zero” signals streams 108, or 8 aggregated or WF muxedvideo substreams. Each of the WF muxed video substreams D1-D8 is aweighted sum of the 5 input video substreams 104, i.e. S1-S5, theprobing sequence 109, i.e. Sx, and 2 “zero” signals streams 108, whichare independent. As a result, each of the 8 aggregated or WF muxed videosubstreams 106, i.e. D1-D8, at the output ports wfc1-wfc8 of the WFmuxer 101, feature results of structured arithmetic operations(weighting, or multiplying, and summing) on the 5 independent data sets104, i.e. S1-S5, one probing data sequence 109, i.e. Sx, and two “zeros”data sets 108. The 8 aggregated or WF muxed video substreams D1-D8appear as 8 respective data streams with random numbers.

Most commercial software tools run the arithmetic operations withlimitations on word lengths of integers. The operations of addition andsubtraction in the WF muxing transformation can go beyond the maximumword length of 8 bytes. Each video block of the video substreams 104,i.e. S1-S5, may have a size of about 1 MB that may be divided into about143,000 words with 7-byte length. To perform arithmetic addition andsubtraction on 8 blocks of the input data sets including 5 videosubstreams 104, i.e. S1-S5 in the same time frame, the probing data set109, i.e. Sx, and the “zero” data sets 108, the first 7-byte word fromthe video stream data of S1 may be added to the first 7-byte word fromthe video stream data of S2. The sum is saved in the block D1 as thefirst word, which will be with a format of 8-byte word to assure of nooverflow or underflow issues. There is a 8/7 ratio of the memory size ofthe WF muxed video substream D1, D2, D3, D4, D5, D6, D7 or D8 to that ofsegmented video substream S1, S2, S3 S4 or S5; more than 15% ofadditional memory size is required for the WF muxed video substream 106,i.e. D1, D2, D3, D4, D5, D6, D7 or D8, compared to the segmented videosubstream 104, i.e. S1, S2, S3 S4 or S5.

Alternatively, each video block of the video substreams 104, i.e. S1-S5,may may have a size of about 1 MB that may be divided into about 143,000words with 7-byte length. To perform arithmetic addition and subtractionon 8 blocks of the video substreams 104, i.e. S1-S5, the probing dataset 109, i.e. Sx, and the “zero” data sets 108, each first 7-byte wordsof the video data sets 104, i.e. S1-S5 in the same time frame, theprobing data set 109, i.e. Sx, and the “zero” data sets 108 may beweighted by respective weighting parameters and then may be addedtogether into a sum represented as either one of the WF muxed blocksD1-D8, each of which may be in a format of 8-byte word to assure nooverflow or underflow issues. There is a 8/7 ratio of the memory size ofthe WF muxed video substream D1, D2, D3, D4, D5, D6, D7 or D8 to that ofsegmented video substream S1, S2, S3 S4 or S5; more than 15% ofadditional memory size is required for the WF muxed video substream 106,i.e. D1, D2, D3, D4, D5, D6, D7 or D8, compared to the segmented videosubstream 104, i.e. S1, S2, S3 S4 or S5 D1-D8.

One may conceivably construct software routines or digital calculatorsto perform arithmetic operations of addition/subtraction word by wordamong video blocks S1-55, each of which has about 10101 words with 99byte word-length in each time frame, so as to generate a result in aformat with a word length of 100 bytes. In this case, the additionalmemory size for each of the 8-to-8 WF muxed video substreams 106, i.e.D1-D8, is about 1% more than that of either of the segmented videosubstreams 104, i.e. S1-55. The muxing processor 103, such as time,frequency or code domain multiplexer, allows the 8 pre-processed datasets, i.e. the output data sets D1-D8 from the WF muxer 101 in parallel,to be muxed based on time, frequency or code and then delivered inseries through a single pipe, or communication output port 107 tovarious data mirror sites 131-1 through 131-8 in IP Cloud storage 130via Internet.

Mirroring Sites in IP Network 130:

As shown in FIGS. 7A, the five independent video substream data sets104, i.e. S1, S2, S3, S4 and S5, a known probing data set 109, i.e. Sx,and two “zero” data sets 108 are muxed by the WF muxer 101 into 8 datasets D1-D8 to be stored in 8 local folders, i.e. memory sets,synchronized automatically in series with 8 respective data storagesites or data mirror sites, i.e. 131-1 through 131-8, in IP cloud 130,which may be provided by different cloud storage providers respectively,via Internet. The 8 data sets D1-D8 may be 8 different linearcombinations of the five video substream data sets 104, i.e. S1-55, theknown probing data set 109, i.e. Sx, and the two “zero” data sets 108.Each of the mirror sites 131-1 through 131-8 only stores an assigned oneof the 8 MF muxed video substream data sets 106, i.e. D1-D8, from theoutput ports, i.e. wfc1 through wfc8, of the WF muxer 101.

Post Retrieval Processing 620:

FIG. 7B depicts the demuxing processor 113, such as time, frequency orcode domain demultiplexer, that may recover parallel data sets 116, i.e.D′1-D′8, based on time, frequency or code from the data sets, stored in8 separated local folders, i.e. memory sets in a local memory device ata receiving site, synchronized automatically in series with 8 storage ormirror sites 131-1, 131-2, 131-3, 131-4, 131-5, 131-6, 131-7 and 131-8in IP Cloud storage 130 via Internet so as to enable users to use the WFdemuxing transformation 111 to retrieve data sets S′1-S′5, substantiallyequivalent to the input data sets S1-S5 respectively if the stored datasets are not contaminated. The data sets 116, i.e. D′1-D′8, may besubstantially equivalent to the data sets 106, i.e. D1-D8, respectively.

FIG. 7B depicts an operation concept for reconstructing the desiredvideo streams S′1-S′5 from only 5 of the 8 WF muxed data sets stored inthe mirror sites 131-1 through 131-8. As indicated in this example, thefirst 5 WF muxed data sets arriving the WF demuxer 111 are D′2, D′3,D′4, D′S and D′8. The last three WF muxed sets arriving the WF demuxer111 are D′1, D′6 and D′7 that may be omitted to be demuxed by the WFmuxer 111. Only the first 5 of the 8 WF muxed video substream data setsarriving the WF demuxer 111 are used for retrieving or recovering thevideo data sets S′1-S′5 that may be combined into the desired videostream 115, i.e. U′1. The first 5 WF muxed video substream data sets,i.e. D′2, D′3, D′4, D′S and D′8, arriving the WF demuxer 111 areillustrated where:

D′2=S′1−S′2+S′3−S′4+S′5−S′x  (20-1)

D′3=S′1+S′2−S′3−S′4+S′5+S′x  (20-2)

D′4=S′1−S′2−S′3+S′4+S′5−S′x  (20-3)

D′5=S′+S′2+S′3+S′4−S′5−S′x  (20-4)

D′8=S′1−S′2−S′3+S′4−S′5+S′x  (20-5)

Therefore, the recovered data sets, i.e. S′1, S′2, S′3, S′4, and S′5 canthen be solved one time frame by one time frame by the modifiedwavefront demuxer 111 where:

S′1=(D′2+D′3+D′5+D′8)/4  (20-6)

S′5=(D′4−D′8)/2  (20-7)

S′3=(D′2+D′5)/2−S′1+S′x  (20-8)

S′2=(D′5−D′8)/2−S′3+S′x  (20-9)

S′4=(D′3−D′4)/2+S′2+S′x  (20-10)

Where: S′x is the known probing data sets, which is equivalent to thedata set 109, i.e. Sx.

The data sets 116, i.e. D′1-D′8, may be substantially equivalent to theoutput data sets, i.e. D1-D8, respectively if not contaminated. Thereby,the recovered data sets 114, i.e. S′1-S′5, if not contaminated, may besubstantially equivalent to the data sets, i.e. S1-S5, respectively.There are many different combinations of taking 5 WF muxed sets 117 from8 ones stored in the respective data mirroring sites 131-1 through131-8. In this case, there are 56 possible combinations to be present.The modified WF demuxer 111 shall be designed to handle the all possiblecombinations. There are many different but equivalent methods/approachesof solving 5 simultaneous equations for 5 unknowns. Each of theretrieved data sets or video blocks 114, i.e. S′1-S′5 in the same timeframe, may be a linear combination of the data sets 116, i.e. D′2, D′3,D′4, D′5 and D′8 in the same time frame, each weighted by acorresponding weighting parameter. Each of the retrieved data sets 114,i.e. S′1-S′S in the same time frame, contains information associatedwith the data sets 116, i.e. D′2, D′3, D′4, D′S and D′8 in the same timeframe.

The recovered 5 parallel video substream blocks 114, i.e. S′1-S′S in thesame time frame, may be combined into a large data set U′1, i.e. 115,including 5 sequential video blocks, i.e. S′1-S′5, via thede-segmentation processor 112.

FIG. 8A and FIG. 8B depict multiple functions of the pre-storageprocessor 110 and the post-storage processor 120 for distributed datastorages. In summary, referring to FIGS. 8A and 8B, in the pre-storageprocessor 110, there are three major functions: (1) segmenting 812,which may be performed by the above segmenting processor 102, (2)encrypting 813, which may be performed by the above WF muxer 101, and(3) redundancy generating 811, which may be performed for generating theabove probing or diagnostic data set, i.e. Sx, and the “zero” data set.Besides the pre-storage processor 110, a pre-storage device 820 in auser device may further comprise local memories 631-x, as abovementioned as the local folders, which may be utilized as part ofdistributed storage.

In the post-storage processor 120, there are also three functions: (1)de-segmenting 822, which may be performed by the above de-segmentingprocessor 112, (2) de-encrypting 823, which may be performed by theabove WF demuxer 111, and (3) redundancy removing 821, which may beperformed for removing the above probing or diagnostic data set, i.e.Sx, and the “zero” data set. Besides the post-storage processor 120, apre-storage device 830 in another user device may further comprise localmemories 631-x, as above mentioned as the local folders, which may beutilized as part of distributed storage.

FIGS. 9A, 9B, and 9C depict three different examples of stored data orrequired memory sizes; each utilizing three different methods 902 onsame data set 901 to achieve the goals of secured data storage. Thethree different methods 902 are (1) method 1 902-1 featuring a 1 to 4segmentations only, (2) method 2 902-2 featuring a1-to-4 segmentationand a 4-to-4 wavefront multiplexing, and (3) method 3 902-3 featuring a1-to-3 segmentation with redundancy and a 4-to-4 Wavefront multiplexing.There are three corresponding readers 905 with key features 906 andoutput data or memory sizes 907. The three examples are for three verydifferent inputs. Input for example 1 depicted FIG. 9A features a fileof 12 numerical numbers from 1 to 12. The 4 segmented subsets of the 12numbers after preprocessed by a writer of method 1 902-1 are stored at 4separated storage sites 903 on cloud. Each features 3 numerical numbersonly; a first subset of [1, 5, 9] is placed in cloud storage 1, a secondsubset of [2, 6, 10] is placed in cloud storage 2, a third subset of [3,7, 11] is placed in cloud storage 3, and a 4^(th) subset of [4, 8, 12]is placed in cloud storage 4. There are 12 numerical numbers at theinputs, and 12 stored on cloud for method 1. These 12 numbers arerecoverable only by reader 1 of readers 905 as indicated in the outputbox 906 using all 4 stored data subsets 903.

Similarly, the 4 segmented subsets of the 12 digits after preprocessedby a writer of method 2 902-2 are stored at 4 separated storage sites903 on cloud. Each also features three numerical numbers; a first subsetplaced in cloud storage 1 shall become [10, 26, 42], a second subset incloud storage 2 shall be [−2, −2, −2], a third and a 4^(th) subsets incloud storage 3 and 4 shall be [−4, −4, −4] and [0, 0, 0], respectively.There are 12 numerical numbers at the inputs, and 12 stored on cloud formethod 2. These 12 numbers are recoverable only by reader 2 of readers905 as indicated in the output box 906 using all 4 stored data subsets903.

However, the 4 segmented subsets of the 12 numbers after preprocessed bya writer of method 3 902-3 are stored at 4 separated storage sites 903on cloud. Each shall feature four (instead of three) numbers; a firstsubset placed in cloud storage 1 shall become [6, 15, 24, 33], a secondsubset in cloud storage 2 shall be [2, 5, 8, 11], a third and a 4^(th)subsets in cloud storage 3 and 4 shall be [0, 3, 6, 9] and [−4, −7, −10,−13], respectively. There are 12 numerical numbers total at the inputs,but there are 16 numbers total stored on cloud for method 3. These 12original numbers are recoverable only by reader 3 of readers 905 asindicated in the output box 906, using any 3 of the 4 stored datasubsets in 903.

FIG. 9B as a second example summarizes data storage sizes on anadvertising video clip with a total length of 34.94 MB digital stream.Using method 1 902-1 for segmentation, each subset stored on cloudstorages 903 shall only feature a 8.735 MB digital substream. Theoriginal video is recoverable by a corresponding reader 1 of the readers905 using all 4 subsets of stored data. The recovered video is identicalto the original one. On the other hand, via using method 2 902-2 forsegmentation and WF muxing, each subset stored on cloud storages 903shall only feature a 9.99 MB digital substream. The 1.25 MB additionalmemory size increasing are the 12.5% (99.9-8.74)/99.9 arithmeticprocessing over-head as discussed earlier. The original video isrecoverable by a corresponding reader 2 of the readers 905 using all 4subsets of stored data. The recovered video shall be identical to theoriginal one. When the video is preprocessed by method 3 902-3 featuringa 1-to-3 segmentation, a 4-for-3 redundancy, and a 4-to-4 WF muxing,there shall be 4 video subsets. Each subset stored on cloud storages 903shall only feature a 13.3. MB digital substream. The 3.3 MB and 1.25 MBadditional memory size increasing are the 33.33% of 4-for-3 redundancyand the 12.5% (99.9-8.74)/99.9 arithmetic processing over-head asdiscussed earlier. The original video is recoverable by a correspondingreader 3 of the readers 905 using any 3 of the 4 subsets of stored data.The recovered video shall be identical to the original one.

FIG. 9C as a third example summarizes data storage sizes on storage ofthree independent videos each with a length slightly less than or equalto 11.7 MB digital stream. There is no segmentation processing at all.Thus, method 1 and method two are not applicable. Using method 3 902-3for a 4-for-3 redundancy and a 4-to-4 WF muxing, there shall be 4subsets of preprocessed data; each subset stored on cloud storages 903shall only feature a 13.3 MB digital substream. The original video isrecoverable by a corresponding reader 3 of the readers 905 using any 3of the 4 subsets of stored data. The recovered video is identical to theoriginal one. The three inputs feature 35.1 MB data streams and thestored data size is 4*13.3 MB or 53.2 MB. The additional memory comesfrom two sources: arithmetical processing overhead of 12.5% and a4-for-3 redundancy of 33.3%.

The WF muxing and demuxing techniques enable concepts and associatedmethods of multicasting of independent multiple data sets to variousindependent groups via a common set of transporting data packages. Thetransporting data packages featuring redundancy are WF muxed datasubsets from multiple data inputs designated to various targeted usergroups. Various user groups with their own data strings are assigned todesignated input ports of a common WF muxing processor at the sendingend, and different customized receivers accessible only to variousdesignated output ports of a corresponding common WF demuxingtransformation. The WF muxing/demuxing transformations are remotelyprogrammable and reconfigurable.

FIG. 9C summarizes the sizes of data packages of such an application,multicasting to 3 different user groups via a common set of 4transporting packages; each shall receive independent data sets bycollecting 3 of the 4 transporting packages. The three may be theleading (in time domain) three packages. Different users at variouslocations shall result with various sets of three packages. Theremaining redundant one may be discarded or may be used for integritychecks, diagnostic, or other purposes which may not needed on every“frames” of multicasting. There shall be 24 different combinations ofranking 3 from 4 possible packages.

With regards to the above WF muxer, the WF muxer may alternativelyperform a first non-orthogonal matrix on the inputs of the WF muxer.With regards to the above WF demuxer, the WF demuxer may alternativelyperform a second non-orthogonal matrix, inverse to the firstnon-orthogonal matrix, on the inputs of the WF muxer.

The components, steps, features, benefits and advantages that have beendiscussed are merely illustrative. None of them, nor the discussionsrelating to them, are intended to limit the scope of protection in anyway. Numerous other embodiments are also contemplated. These includeembodiments that have fewer, additional, and/or different components,steps, features, benefits and advantages. These also include embodimentsin which the components and/or steps are arranged and/or ordereddifferently.

Unless otherwise stated, all measurements, values, ratings, positions,magnitudes, sizes, and other specifications that are set forth in thisspecification, including in the claims that follow, are approximate, notexact. They are intended to have a reasonable range that is consistentwith the functions to which they relate and with what is customary inthe art to which they pertain. Furthermore, unless stated otherwise, thenumerical ranges provided are intended to be inclusive of the statedlower and upper values. Moreover, unless stated otherwise, all materialselections and numerical values are representative of preferredembodiments and other ranges and/or materials may be used.

The scope of protection is limited solely by the claims, and such scopeis intended and should be interpreted to be as broad as is consistentwith the ordinary meaning of the language that is used in the claimswhen interpreted in light of this specification and the prosecutionhistory that follows, and to encompass all structural and functionalequivalents thereof.

What is claimed is:
 1. An apparatus comprising: N audio receiverspositioned in a pre-defined geometry with respect to P audio sources toreceive P audio signals from the P audio sources; N data sets coupled tothe N audio receivers to sample the received P audio signals into N datastreams; a plurality of storage devices coupled to the N data sets tostore the N data streams; and a post processor coupled to the pluralityof storage devices to generate output signals corresponding toreconstituted P audio signals using a wavefront demultiplexingtransformation, wherein N and P are positive integers and N≥P, andwherein the post processor has inputs receiving data retrieved from theplurality of storage devices and outputs providing the output signals.2. The apparatus of claim 1 further comprising: a plurality of audiotransmitters coupled to the post processor to transmit the reconstitutedP audio signals.
 3. The apparatus of claim 1 wherein the pre-definedgeometry includes source distances among the P audio sources, distancesamong the N audio receivers, and distances between the N audio receiversand the P audio sources.
 4. The apparatus of claim 1 wherein the postprocessor comprises a digital beam forming processor to generate Porthogonal beams corresponding to the reconstituted P audio signals. 5.The apparatus of claim 4 wherein each of the P orthogonal beams has apeak at a direction associated with one of the P audio sources.
 6. Theapparatus of claim 1 wherein the wavefront demultiplexing transformationincludes information related to the pre-defined geometry.
 7. Theapparatus of claim 6 wherein the information related to the pre-definedgeometry includes time delays from the P audio sources to the N datasets.
 8. The apparatus of claim 1 wherein one of the outputs is a linearcombination of the inputs weighted by a corresponding weightingparameter.
 9. A method comprising: receiving P audio signals from Paudio sources using N audio receivers positioned in a pre-definedgeometry with respect to the P audio sources; sampling the received Paudio signals into N data streams using N data sets coupled to the Naudio receivers; storing the N data streams in a plurality of storagedevices coupled to the N data sets; and generating output signalscorresponding to reconstituted P audio signals using a post processorperforming a wavefront demultiplexing transformation, wherein N and Pare positive integers and N≥P, and wherein the post processor has inputsreceiving data retrieved from the plurality of storage devices andoutputs providing the output signals.
 10. The method of claim 9 furthercomprising: transmitting the reconstituted P audio signals by aplurality of audio transmitters coupled to the post processor.
 11. Themethod of claim 9 wherein the pre-defined geometry includes sourcedistances among the P audio sources, distances among the N audioreceivers, and distances between the N audio receivers and the P audiosources.
 12. The method of claim 9 wherein generating the output signalscomprises generating P orthogonal beams corresponding to thereconstituted P audio signals using a digital beam forming processor.13. The method of claim 12 wherein each of the P orthogonal beams has apeak at a direction associated with one of the P audio sources.
 14. Themethod of claim 9 wherein the wavefront demultiplexing transformationincludes information related to the pre-defined geometry.
 15. The methodof claim 14 wherein the information related to the pre-defined geometryincludes time delays from the P audio sources to the N data sets. 16.The method of claim 9 wherein one of the outputs is a linear combinationof the inputs weighted by a corresponding weighting parameter.
 17. Acommunication system comprising: P audio sources generating P audiosignals; and an apparatus coupled to the P audio sources, the apparatuscomprising: N audio receivers positioned in a pre-defined geometry withrespect to the P audio sources to receive the P audio signals; N datasets coupled to the N audio receivers to sample the received P audiosignals into N data streams; a plurality of storage devices coupled tothe N data sets to store the N data streams; and a post processorcoupled to the plurality of storage devices to generate output signalscorresponding to reconstituted P audio signals using a wavefrontdemultiplexing transformation, wherein N and P are positive integers andN≥P, and wherein the post processor has inputs receiving data retrievedfrom the plurality of storage devices and outputs providing the outputsignals.
 18. The communication system of claim 17 wherein the apparatusfurther comprises: a plurality of audio transmitters coupled to the postprocessor to transmit the reconstituted P audio signals.
 19. Thecommunication system of claim 17 wherein the pre-defined geometryincludes source distances among the P audio sources, distances among theN audio receivers, and distances between the N audio receivers and the Paudio sources.
 20. The communication system of claim 17 wherein one ofthe outputs is a linear combination of the inputs weighted by acorresponding weighting parameter.